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PRPRI.F.MF  I*!  CPNPFPTt'Al  WM.YSTS  Of  NATURAL  I.AKHIAPF 


Lawrence  Pirnbnum  and  Mallory  Selfr'dge 


ARPTRAPT 

This  paper  reports  on  some  recent  developments  In  natural 
language  analysis.  We  address  such  Issues  as  the  role  of 
syntax  In  a  se"tan  f  1  c  s-or  lent  ed  analvrer,  achieving  a 

flexible  balance  of  top-down  and  hottom-up  processing,  and 

the  role  of  short  fern  memory.  Pur  results  have  led  to 

Improved  aleorlfi—s  capable  of  analyzing  the  Unis  of 

multi-clause  Inputs  founi  ‘n  most  text. 


I.p  T V’RPhlTTTPN 

This  paper  reports  on  some  recent  d eve  1 oprnon t s  In  conceptual 
apalvsis  of  natural  language.  Vorl  on  conceptual  analysis  has  heen 
proceeding  for  several  vc»rs  now,  starting  with  the  work  reported  In 
Rchank  et  al  .  (1R7P)  and  Plesheck  M975).  We  have  built  on  that 

work,  rorrrnt  rot  inf  on  some  Important  theoretical  Issues  that  we  feel 
have  not  received  sufficient  attention: 

(1)  Vhat  is  the  role  o*  syntax  In  i  seman t 1 c s-or ient ed 
language  analysis  process’ 

(?)  Vhat  ‘s  t  t>e  proper  relationship  between  top-down  and 
bottom-up  modes  of  operation’ 

(11  'tow  does  shorf-ter'~  "vnnrv  structure  affect  the  analysis 
process’ 

(41  Vt’af  is  the  r'ght  vocabulary  (formal  isml  for  expressing 
the  rroress'ng  Vnovledee  that  the  system  has’ 

(41  l^at  .are  the  criteria  on  the  performance  of  a  word-sense 
d 1 «amh« ena 1 1  op  nroeess  which  we  should  strive  to  achieve’ 

Pur  wort  has  provided  some  answers  to  the  above  Questions,  which  have 

fp  turn  enabled  us  to  construer  more  flexible  algorithms,  capable  of 
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analysing  the  kinds  of  complex  noun  groups  and  multi-clause  inputs 
found  in  most  text.  It  was  precisely  this  sort  of  input  which  caused 
problins  in  previous  conceptual  analysis  programs. 


1.1  Outline  of  tv'(»  paper 


Sections  ?  anr  i  comprise  a  "primer"  on  conceptual 
analysis.  Section  2  discusses  the  hackround  assumptions  of 
conceptual  analysis,  and  presents  the  notion  of 
ex  pec  tat  ions. 


Section  1  discusses  the  minimal  machinery  reoui red  to 
perform  conceptual  anaiys's.  Oir  theoretical  concerns  lead 
to  a  design  which  differs  in  several  respects  from  previous 
conceptual  analysis  programs. 

Section  1*  presents  a  s^ort  example  analysis  performed 
by  our  "minimal"  analvrer. 

Section  S  discusses  in  preater  detail  previous  models 
of  conceptual  analysis  and  some  of  the  problems  wo 
d i scovered  . 

Section  S  describes  'n  detail  the  implementation  of 
ex  pec  t  at  1 ons . 

Section  7  describes  .and  justifies  some  necessary 
augment  a t i ons  of  the  simple  control  structure  presented  In 
section  1 . 

Section  S  discusses  some  or  the  theoretical  Issues  that 
have  motivated  our  work:  the  role  of  syntax  in  a 

semantics-oriented  language  analvrer,  language  acquisition, 
and  the  possibilities  of  "  1  n r e  1  1  1  p.en t  error  correction". 

Section  presents  our  analysis  of  the  problem  of 
word-sense  ambiguity,  and  of  some  pnsjsihli  solutions. 

Section  10  discusses  the  program  which  implements  our 
ideas  and  presents  some  example  analyses  it  performs. 

Section  11  presents  some  nt  our  conclusions. 

Thr  append4*  cent  a 4  ns  a  detailed  example. 


■ - - 
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2.0  BAOKRPl'Nn 

The  po.il  of  the  conceptual  analysis  process  Is  to  irnp  natural 

language  innut  into  a  representation  of  its  meaning  (see  Schank 

(!°7S)).  Ve  ire  thus  concerned  with  explaininp  how  a  machine  or  human 

might  derive  the  meaning  of  some  input  text  based  upon  the  meanings  of 

the  voris  and  phrases  from  which  it  is  composed,  plus  other  knowledge. 

This  pon’  differs  from  that  assumed  hv  most  models  of  parsing,  which 

ho'd  that  the  purpose  of  the  parsing  mechanism  is  to  perform  a 

syn  tac  t i c  analysis  of  the  input  sentences.  Tn  other  words,  the  goal 

of  a  conceptual  analvzer  Is  to  derive  the  semantic  and  memory 

structures  underlying  an  utterance,  whereas  the  Real  of  a  syntactic 

1 

parser  is  to  discover  its  (syntactic)  structural  description. 
However ,  since  unv  understanding  system  must  eventually  transform  text 
Into  some  infernal  semantic  representation,  it  is  clear  that 
conceptual  .analysis  suhsumes  the  ultimate  purpose  of  traditional 
syntactic  pursing  algorithms.  We  claim  that  such  prior  syntactic 
analysis  Is  unnecessary,  and  fh.it  for  this  and  other  reasons  It  is  not 
a  plausible  part  of  a  model  of  human  language  understanding.  This,  of 
course,  does  not  mean  fh.it  vs-  deny  the  existence  of  syntactic 
phenomena  or  of  syntactic  knowledge:  we  are  arguing  against  the 

notion  of  a  separate  syntactic  analysis  phase. 


(1)  See,  for  example,  -r*-ornc  et  al.  ( 1  °h® ) ,  Bobrov  and  Fraser  (19f>9)t 
Woods  (1070),  VI  nog  rad  (1972),  Kaplan  (1°7S),  ‘'arcus  (1°7S),  “arcus 
(1°79).  Our  own  point  of  view  is  derived  from  the  work  of  Schank  and 
RIeshrck.  Prev*ous  vorK  Is  described  in  Schank  et  al.  (1970), 
Plesheck  (1°7S),  RiesherV  and  Schank  (l°7h),  Oershman  (1°77)  .and 
(1°7°).  For  somewhat  different  work  with  similar  motivations,  see 
V'i  1 V s  fl°71)  and  (l°7f).  For  related  work  with  differing  motivations, 
see  Burton  ( 1 °7f  ) . 


Since  the  goal  of  conceptual  analysis  differs  from  the  goal  of 
syntactic  parsing.  It  Is  understandable  that  the  mechanisms  which  are 

employed  differ  as  well.  In  particular,  it  is  our  goal  that  the 

conceptual  analysis  process  should  use  any  and  all  available  knowledge 
whenever  helpful.  Such  knowledge  may  Include  syntactic  knowledge,  but 
is  certainly  not  limit  on  to  that.  Because  the  goal  of  the  process  is 
no  longer  seen  as  pe r f orn i np,  syntactic  analyses  (which  are  tvpieallv 
supposed  to  serve  as  input  to  some  semantic  Interpreter),  there  is  no 
hint  of  circularity  in  the  use  of  non- svn t ac t 1 c  information.  It  is  a 
claim  of  the  theory  that  non- 1 i npui st i c  knowledge  is  often  crucial 
even  at  the  earliest  points  in  natural  language  processing. 

Because  the  goal  of  conceptual  analysis  is  to  map  natural 

language  into  a  conceptual  representation  of  the  meaning,  an  adequate 
representation  must  bp  specified.  In  wh.at  follows,  we  will  employ 
conceptual  dependency  (Cht  (see  Scb.ank  (  1  Q7 *>  )  ,  Srhank  and  Ahclson 
(1°77)).  However,  we  believe  that  the  principles  and  mechanisms  of 
conceptual  analysis  are  to  a  large  extent  independent  of  the 

particular  representation  chosen,  as  long  as  that  representation  meets 
certain  criteria.  Almost  anv  we  1 1 -devel oped  system  based  on  case 
frames  (see  Pruce  ( l  **  7  ^ )  seems  adequate.  Case  frame  representations 
are  useful  because  they  natural lv  contain  a  preat  deal  of  information 
on  the  possible  connecHnns  between  anv  items  so  represented,  in  the 
for"  of  unfilled  case  slots. 


?  .  1  Fx  nee  t  .it  Ions 


Mow  r.in  we  characterise,  !n  .1  roupb  sens",  the  process  of 
language  un'ierstand  Inc7  f  1  .’npji.ipe  understander  mist  Conner  t  concepts 
which  ire  oht  lined  from  wor-1  "e.inlnfs,  ind  from  Inferences  derived 
frnm  word  meanings,  Into  .1  coherent  represent  it  lor  of  fbp  Input  ns  a 
whole.  Because  of  the  po  ss  *  h<  1  1 1 1  es  of  vsird-sense  ambiguity  or 
Irrelevent  Inference,  in  underst  ander  must  also  be  able  to  c  boose  from 
'monp  alternative  concepts.  T,’ns1  conceptual  analysis  consists  mainlv 
ol  connect'ne  .in'*  d  I  satnHgua  t  *  ne  (  1  .e . ,  rbooslne  amonp) 
represent  it  lone  ’  s  t  r  nr  t  ur  ••  s  . 

T^e  proress'np  lnew!edp<  O-lch  f  be  system  uses  for  this  tisV  .ire 
expectations  free  Pc  !•  ink  e  r  .1 1  .  (  1  °70 1  ,  PiesberV  (  f  0  7  S  1  ,  Plesberk  and 

Frb.mW  When  1  ne  rso"  Virs  or  reeds  words  wl  t  b  rertaln 

meanings,  be  expects  or  p'ed'ets  tbit  words  wl  t  b  certain  other 
no.inlics  m  e  v  follow,  or  “>  ’  V  Vive  already  been  s"en  .  People  constantly 
ro  r~  expectations,  pee  *  « c  t  1  on  s  is  to  w*-if  they  ire  llVelv  tn  see  next, 
Vised  on  vV’ t  rSey  have  read  and  und«  r  =  tood  so  far  an4  on  wbat  they 
’'now  lSeut  I  inriutr  ant  fh«»  world,  .ind  they  use  these  esprrt.1t  'ons  to 
disambiguate  -nl  rmrrrt  (nrom'np  text. 

of  ron'sr ,  rxtvrt it  1 nns  ire  used  In  syntactic  analysis  programs 
as  vs- 1  1  .  -rbe  difference  lies  In  the  origin  of  tV  expectations.  In 
syntactic  analysers,  the  etprct.it  Inns  ire  der'ved  from  a  grammar.  In 
VfinV  et  al .  (lQ7n>,  It  was  recognised  that  the  expectations  should 

be  governed  by  f  h"  'nromnlete  rase  structures  representlnp  the  meanfnp 


of  the  Input 


P.ip.c  f' 


To  illustrate  the  use  of  expectations  In  understand  1 np ,  suppose 
that  the  following  simple  sentence  were  the  input  to  an 
expectation-based  conceptual  analysis  system:  "Fred  ate  an  .apple." 
Reading  from  left  to  rlp.ht  ,  the  system  first  finds  the  word  "Fred". 
Since  there  are  as  vet  no  ex  pec t a t i ons ,  the  system  simplv  understands 
this  as  a  reference  to  some  male  hitman  belnp  named  Fred,  and  stores 
the  reference,  represented  as  the  token  FDFP,  in  some  kind  of  short 
term  memory.  Ty'>'  next  word  is  "ate".  Th '  s  *  s  understood  as  an 
instance  of  the  concept  of  eatinp,  which  in  conceptual  dependency  is 
represented  hv  t  case  frame  something  like  this:  (lhTF.S‘r  ACTOR  (NIL) 
OBJFCT  (NIL)).  Also,  the  meanine  of  "ate"  supplies  some  expectations 
which  pive  hints  >s  m  how  to  po  about  fillinp  the  unf'lled  slots  of 
this  case  frame.  One  of  these  ex  pee  t  a  t  i  on  s  sup.p.exts  that  the  ACTOR  of 
the  TFCFST,  an  animate  brine,  mav  have  already  been  mentioned.  So  the 
analyrer  checks  short  term  memory,  finds  FRFP  there,  and  Mils  'fo 
ac moR  sin,  0f  fhe  tncvct:  (Tsc^sm  actor  ( fkfp)  np.tvr-r  (Nil.)). 

Oir ro  remains  an  unfulfilled  expectation,  which  suePests  that 
some  ment*on  will  he  ma-ie  of  what  it  is  that  Fred  ate,  that  it  should 
he  some  edible  thine  (nr  at  least  a  phys'cal  obdort),  and  that  it 
should  fill  the  OR.IRCT  slot.  Next,  the  word  "an"  is  read.  ‘rh  1  s 
creitr«'  in  expert  ition  that  some  instance  e*  a  concept  should  follow, 
an'i  instructs  that  if  one  <«*  fnmvi ,  it  should  he  marked  .as  a  new 
'nst.anre  of  that  concept  .  (This  is  information  which  can  aid  memory.) 
Finally,  "apple"  Is  read.  It  Is  understood  as  an  'nstanre  of  the 
concept  AT,F1.C ,  represent'np  somctMne.  which  Is  known  to  he  r  .  The 
expectation  created  vhen  "an"  was  read  Is  satisfied,  so  APThF  ‘s 


airtr-i  as  an  oVIert  not  previously  seen,  which  we  vi  1  1  represent  as: 
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(A PPL?  RFF  (  IN'nFF))  .  The  second  expectation  created  when  "ate"  was 
read  Is  il  so  satisfied,  so  t  he  oa.JprT  slot  of  the  INCFST  Is  filled  by 
( APP1.F  °FF  <  INDPP))  .  The  system's  current  understanding  of  the  Input 
Is  represented  as  (1VCFFT  afTOR  rn>Fn>  OHJFrT  (APP1.F  RFP  (  1  NPF F  )  )  1  . 
Tx’rc  are  no  "lore  words  to  read,  so  the  process  halts. 

The  above  example  elves  an  Idea  of  the  conceptual  analysis 
process.  When  a  word  is  read,  the  conceptual  structure  representing 
the  meaning  of  that  word  Is  added  to  short  term  memorv.  In  addition, 
expectations  are  created,  which  provide  the  processing  knowledge 
necessary  to  connect  up  these  conceptual  structures  into  a 
representation  of  the  input  as  a  whole. 

t.P  \  v  IN'!W  ‘  1  n  sr»  i"l'M  »*'MY7rB 

riven  that  one  is  'estpnlnp  an  <’xp-rt  at  inn-dr  ivrn  understander, 
what  mechmis*-  ran  he  used  to  implement  ex  pe  r  t  a  t  1  on  s 1  Vurh  of  the 
svs'em  design  will  depend  o->  this,  Following  PlerhecF  (  see  Plesherk 
(!07t>M,  we  chose  to  tmnle-ien'  ex  per  t  a  f  1  ons  bv  oslnp  test-action  pairs 
Vnown  is  reciests.  If  the  tes'  n(  a  request  Is  checked  and  found  to 
he  true,  then  the  c  or  re  epon't  *  nr  actions  of  the  reourst  are  executed. 
Requests  >re  thus  a  form  e*  production  fs re  Vewell  (1971)1. 

In  the  example  of  the  last  section,  wr  mentioned  that  an 
ex  pec  f  a  t  1  ota  for  an  ed'hle  thing  would  he  eenerated  to  fill  the  IB.TFFT 
slot  of  the  ISTfST  structure  hu*  1  t  hv  "eat".  Implemented  as  a 
reourst,  r  *’ *  s  expectation  would  1  ooF  something  like  this; 

TfRT :  Tan  a  concept  representing  an  edible  ohlert  he  found’ 

Aff TON :  Tut  it  in  the  rR.TFfT  slot  of  the  lN<~F5‘r  concept. 


TM«  request  Is  ac  t  i  vat  ed  when  the  word  ate  Is  read  or  heard.  Its 
test  her  tune  true  in  our  example  above  when  the  mraninp  of  the  word 
"apple"  was  understood,  and  its  action  specified  that  APP1.F  was  to  be 
taken  as  the  PH  tvCT  of  the  1V0FST.  (Usually,  we  will  describe 
requests  even  more  informally,  as  somethinp:  like  "If  you  can  find  an 
edible  thing,  then  put  it  in  the  PPJFCT  slot."! 

Using  tills  ipproacb,  the  conceptual  analysis  process  can  be  most 
easily  described  as  a  special  type  of  production  svstera.  Several 
questions  then  arise: 

(1'  V*at  kind  of  control  structure  is  needed1 
1 1  i  What  k ' nd s  of  tests  and  actions  can  requests  perform1 
(  d  )  Where  .are  reqaiests  stored,  and  how  are  t>-ev  arressed1 
The  rest  of  this  section  will  give  pre!  'n'n.irv  antwris  to  each  of 
these  questions  in  turn. 

As  the  introduction  pointed  out  ,  we  have  been  verv  con-erned  with 
des'gn'np  a  conceptual  anal  vr-r  that  Is  flexible.  We  have  formulated 
tKe  following  criterion,  in  order  to  make  more  nrec i se  what  we  mean  hv 
"  f  1  ex i b 1 1 i t  v"  : 

rriterion  of  flexibility:  A  conceptual  analvrer  must 

possess  the  flexibility  to  alternate  between  top-dovai  .ard 
hot  tom-up  processing  as  warranted  hv  the  situation. 

In  t*-e  framework  of  conceptual  analysis,  "lop-down"  means  the  ability 

f  o  ut 1 1  *  re  ex  per t a t *  on s  if  anv  arr  active.  " Hot t om-up"  means  the 

ability  to  told  onto  Intermediate  structures  and  processing  knowledge 

until  some  erpectafions  are  supplied. 
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1.1  Control  structure 

First  of  all,  a  conceptual  analyser  needs  some  kind  of  short  term 
memory,  a  place  to  hold  the  conceptual  structures  helna  processed. 
Without  a  flexible  FT'*,  a  conceptual  analyser  would  he  unable  to 
remember  substructures  which  are  to  be  assembled  Info  the  final 
representation  of  the  Input.  la*t  us  assume  that  this  short  term 
memory  *s  merely  a  list,  railed  the  Cr'NCFPT -1. 1  FT  or  r-l.JST.  Whenever 
the  processing  knowledge  of  the  system,  In  tie  form  of  requests, 
believes  that  some  conceptual  structure  relevant  to  represent  1  np 
the  meanlny  of  the  (nput  ,  that  structure  Is  «ddod  to  the  end  of  this 
list.  Because  of  this,  most  process'nR  Is  focussed  on  the  end  of  the 
C-I.IF",  and  so  wv  *iv  t*'lnV  n!  It  as  helnR  sorethlnR  like  a  stack. 
t*-!x  lftnJ  n*  1 1  cx  M  ! '  v  In  ho  1 d 1 np  St  r  ur  t  ure  s  Is  essential  If  tie 
parser  ‘s  to  fun.- 1 'on  effectively  *n  a  hottom-up  mode. 

Ferond  ,  a  concepfivxt  a^aly/er  needs  a  data  structure  to  hold  the 
active  requests.  Without  one,  of  course  ,  the  system  would  never  he 
able  to  maintain  any  e»  p.'c  t  a  t  1  ons  .  In  our  minimal  analvrer  (as  in 
p-evlous  conceptual  analvrrrs),  this  Is  also  a  list,  called  the 
rvriTFT-1  IF"  or  P-1. IF",  Thr  system  examines  the  requests  on  the 
P-l.lcT,  and  If  the  test  n(  a  request  Is  true.  Its  actions  are 
executed.  This  process  Is  called  request  cons! dr ret  Ion. 

The  control  structure  of  a  minimal  conceptual  analysts  algorithm 
Is  st r a  I phr forward ,  exactly  the  same  as  that  of  previous  conceptual 
ana  1 vre  r  s  : 

(1  1  ret  the  next  lexical  Item  (word  or  Idiomatic  phrase) 
from  the  input,  readlnp  from  left  to  r'pht;  If  none,  the 
process  terminates; 
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(?)  Load  (urtlvulc)  the  requests  associated  with  the  new 
(ton  Into  the  P-l.  1ST; 

( ? )  Consider  the  active  reouests  In  the  R-LIST; 

(4)  Loop  hack  to  the  beginning  (step  1). 

?.?  Tests  and  art  tons  of  reouests 

As  was  pointed  out  In  the  I n t roduc t I  on ,  It  Is  very  important  that 
the  right  vocabulary  be  devised  to  express  the  processing  knowledge 
the  system  has.  Clven  that  ve  are  using  requests  to  embody  that 
processing  knowledge,  this  problem  becomes  one  of  choosing  the  right 
set  of  tests  and  actions  that  requests  nav  perform. 

There  are  two  general  classes  of  tests  which  requests  may 
pe  r  f  o  ra  : 


(1)  Test  for  the  occurrence  of  a  particular  word  or  phrase; 

(?)  Fx.amine  conceptual  structures  on  the  C-L1FT,  testing  for 
certain  semantic  or  ordering  prope  r  t  I  <•  s  . 

Requests  with  the  first  kind  of  test  are  called  lexical  reouests, 

while  those  with  the  secord  kind  are  called  concept  ua 1  requests  (or 

usually,  lust  requests),  A  more  precise  classification  will  be 

presented  In  section  is  vs- 1  1  as  numerous  examples  of  exactly  what 

things  requests  should  test  for. 

A  request  may  perform  aov  of  the  following  actions  should  Its 
test  herome  true: 

(1  1  Add  a  conceptual  structure  to  the  C-l  1 FT ; 

(?)  Fill  a  slot  In  a  eonceptnal  structure  w*th  some  other 
st  rue  t  ure ; 

(?)  Activate  other  requests,  i ,e .  add  them  to  the  R-LT FT ; 
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(i)  De-activate  rpquesls,  lncludlnR  In  particular 
themse Ives. 

"•here  are  several  variants  of  these  basic  actions  which  will  be 
analyzed  when  thev  are  discussed  In  turn  In  section  6. 

In  practice.  It  seems  convenient  for  requests  to  he  more  like  the 

MSP  'cond * f lonal '  than  traditional  productions.  That  Is,  a  request 

should  consist  of  an  ordered  set  of  tests  controlling  branchlne  to 

a 

mutually  exclusive  actions. 

”1.1  FtorinR  and  accessing  requests 

In  previous  conceptual  analyzers,  reouests  were  often  simply 

oryan! red  under  the  particular  words  *or  which  they  are  useful,  that 

*s,  requests  were  stored  under  words  in  some  kind  of  dictionary.  We 

have  continue-*  to  use  that  method.  For  example,  the  request  created 

when  reading  "an"  would  slmplv  he  stored  under  the  word  "an",  and 

activated  for  use  whenever  that  word  is  read.  This  is  one  wav  of 

orqanlz*nR  requests  so  that  only  those  relevant  to  the  current 

a 

situation  are  active  in  the  system. 


(21  ‘rhis  is  particularly  use f ul  in  allovine  a  rnouept  to  notice  when 
it  is  no  lonyer  appropriate  and  to  then  remove  itself  from  active 
status.  We  ran  accomplish  this  hv  mekinp  ope  of  the  tests  in  the 
request  look  for  clues  that  the  request  is  no  longer  appoprlate. 
ShonM  that  test  become  true,  the  associated  action  vnuld  simply  have 
the  request  de-artlvate  itself. 


( 1  1  Clearly,  not  »!1  analysis  oxpor t at  1  out  should  he  implemented  as 
requests  associated  d 1 rer t 1 v  with  words.  The  question  of  what  other 
structures  or  mechanisms  miyht  he  used  to  oreanlze  expectations  In 
memory,  and  to  access  them,  is  a  topic  of  current  research. 


_ „ _ _ 
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1-et's  sop,  In  detail,  how  the  minimal  conceptual  analyzer  wo  have 
lust  described  mlpht  work  on  another  simple  example,  the  statement 
"Fred  Rave  Sallv  a  book (The  numbers  to  the  left  of  each  step  traced 
below  refer  back  to  tbe  steps  In  the  loop  of  the  control  structure 
sketched  in  section  1.1.) 
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(!)  Read  the  first  word,  "Fred". 

(?)  Activate  the  reauests  In  the  dictionnrv  entry  for 
"Fred".  There  is  onlv  one,  and  if  looks  somethin*  like 
this: 

RFPCF*T  — 

TF*T:  T 

ACTION*:  Add  the  structure  (PP  r  I/.**  (Mi^AN)  NA*F  (FRFP)) 
to  the  C-LIST 

The  svmbo!  "T"  in  the  test  of  this  request  ‘s  always  true, 
so  that  the  action  should  always  be  performed.  When 
activafinp  this  request,  the  svstem  assiens  it  the  name 
PFOO. 

(1)  Tlie  active  requests  are  considered.  There  is  only  one, 
PFPP,  and  it  has  a  true  test,  so  its  action  is  performed. 
Now,  C-LI*T  ••  CON  1,  where  CONI  -  (t*P  CU**  (HPMAN)  NAMF 
(n»FP))  . 

(1  1  The  word  "pave"  is  read. 

(?)  Activate  the  requests  in  the  dictionary  entry  for 
"rave".  For  the  purposes  of  this  example,  there  is  lust  ope 
request  in  this  entry: 

RFCl'FST  — 

TF*T :  T 

ACTION*;  Add  the  structure 

(ATRAV*  ACT™  (NIL)  OR.TFC^  (Nil.' 
to  (NIL)  FRP«  (NIL) 

TIMF  (PAST)) 
to  the  C-LIST 

Aetlvate  the  request 
pfctf*t  — 

TF*T:  Can  vou  find  a  human  on  the  C-i.I*T 
preced'pe  the  ATRANS  structure? 

ACTION* :  P*tt  it  in  the  ACTop  ind  FTP*'  slots 
of  the  ATRAN* 
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Activate  the  request 
PFWFST  -- 

TFST:  Can  vou  find  a  human  on  the  C-L I ST 
foil  owl  ns*,  the  ATRANR  st  rvir  t  urr1 
ACTIONS :  Put  It  In  the  TO  slot  of  the  A’TANS 

Activate  the  request 

pfocpst  -- 

TF^T:  Can  you  M  nd  a  physical  obioct  on  the 
f-1  IN’-  follow,  i.r  the  ATRANS  structure’ 

Af T  Jov^ :  Put  It  In  the  og.frCT  slot  of  the  AfRAVS 

When  activating  this  request,  the  system  assigns  It  the  name 
»FO) . 

(11  Cons'der  the  active  requests.  There  Is  onlv  one,  RF01  , 
Its  test  Is  true  and  so  its  actions  ire  performed.  First, 
It  ad, -is  i  new  structure  to  the  end  of  the  C-LT^T.  No  now 
0 -LIST  -  (CON!  CON?),  where  cry?  Is  the  ATANS  structure 
which  represents  the  meaning  of  "(tave".  Then,  three  new 
requests  .ire  activated,  which  strive  to  fill  the  gaps  lr  the 
A'T}A,-N  structure.  The  Mrst  of  these  requests  strives  to 
fill  the  AOTnq  slot  of  the  ATRA*'s.  When  it  is  activated, 
the  svstem  assigns  it  the  name  PFO?.  The  next  request 
strives  to  fill  the  TO  slot  of  the  A TRANS .  When  It  is 
activated,  the  system  assigns  it  the  name  PFOt.  The  last 
new  request  strives  to  Mil  the  OR  tycy  slot  of  t  be  ATRANS. 
When  it  is  activated,  the  svstem  assigns  It  the  name  PFOA. 

( 1  )  The  svstem  "nw  cons'ders  these  new  requests,  and  PFO?  Is 
found  to  Five  a  true  test.  The  action  of  PTO?  is  executed, 
and  so  ("ONI,  represent  1  ng  "Fred”,  Is  placed  in  the  ACTOR 
slot  of  CON?  (the  ATRANS )  and  removed  from  the  C-1.1NT.  The 
ofhe-  tvai  requests,  PFO’  and  PFOA,  do  not  have  true  tests, 
so  their  actions  are  not  executed.  However,  'hev  do  remain 
as  active  expectations  on  the  P-L1ST. 

(1)  Pead  the  next  word,  "Rally". 

(?)  Activate  the  requests  from  the  dictionary  entry  of 
"Rally".  There  is  onlv  one,  and  it  Is  almost  exactly  l!We 
the  one  for  "Med": 

RFiTFN-  -- 
7fNT;  T 

Af’-ioss;  Add  the  structure  (PF  C1.ANS  (H1WAN)  NAMF  (SALLY)) 
to  the  C-LTS''' 

When  activating  this  request,  the  svstem  assigns  It  the  name 

PF05. 

(1)  Consider  the  active  requests,  PFOS  is  found  to  have  a 
true  test,  so  Its  action  is  performed.  Now  C-LTST  ■  (CON? 
C ON’),  where  CON’  is  the  structure  representing  "Sallv". 
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RFO),  which  Is  still  active,  now  also  has  a  true  test,  and 
so  COM  Is  used  to  fill  the  TO  slot  (recipient)  of  CON?,  the 
A’TLANS  structure,  RF.04  still  does  not  have  a  true  test. 

(1)  Read  the  next  word,  "a". 

(?)  Activate  the  requests  from  the  dictionary  entry  of  the 
current  word.  There  Is  only  one: 

RFCl'FST  -- 

TFST:  Has  a  new  structure  been  added  to  the 
end  of  the  C-LIST? 

ACTION*?:  Hark  It  as  an  Indefinite  reference 

When  activating  this  request,  the  system  assigns  It  the  name 
PFOh. 

(1)  Consider  the  active  requests.  Neither  RF04  nor  RFOh, 
the  only  active  requests  on  the  P-L1ST,  have  true  tests. 
So,  nothin?,  happens. 

(1  )  Read  the  next  wird  ,  "hook". 

(?)  Activate  the  requests  from  the  dictionary  entrv  of  the 
latest  vnrd.  In  this  case,  there  Is  only  one  request: 

RFOUFST  — 

TFST:  T 

ACTION*?:  Add  the  struct  tire 

(PP  CLAS*?  (PH YS ICAL-OR JFCT)  TYPF  (pnov)) 
to  the  C-LIST 

When  activating  this  request,  the  system  assigns  It  the  name 
PFP7. 

( >  )  Consider  the  rema*n1ng  active  requests.  RF07  has  a  true 
test,  so  Its  action  Is  performed:  CON4  Is  added  to  the 
C-LTST,  w*'ere  CON4  Is  the  structure  which  represents  "hook". 
PFOt-  now  has  a  true  test  ,  so  CON4  is  marked  as  an  Indefinite 
reference,  like  this:  (PP  CLASS  (P"YS  1CA1.-OR.TFC-)  Typp 

(pony)  opr  ( T  npf  F ) )  .  RFC/,  also  has  a  true  test,  so  C0N4  Is 
used  to  fill  the  ohiect  slot  til  CON?,  the  ATRANS  structure. 

(|)  There  are  no  more  words  In  the  Input.  The  analysis 
halts,  with  the  following  final  result  representing  the 
1 npuf  : 

(A-’TAVS  ACTOP  (PP  C1.AFC  (”1tMAN)  VAUF  ( FPFP) ) 

ORJFCT  (PP  CUSS  (PHYSICAl.-OR.TFCT) 

TYPP  (ROopl  Rpp  (TNDFP)) 

TO  (t>P  r|>5<;  (HUMAN)  NAMF  (SALLY)) 

FROM  (PP  HASS  (HUMAN)  NA'«F  (FPFP)) 

TTVF  (PAST ) ) 
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S.n  PREVIOUS  WORK  AND  A  CRITTOUF 


Our  work  has  been  great lv 

1  nf  1  lie  need 

by 

previous  theories 

of 

concept  un 1 

anal  vs  1 s 

and  the 

programs  that 

Implemented  them. 

The 

theory  has 

Its  roots 

In  the  paper  of  Nehank 

al.  (  1  970),  but 

t  he 

first  successful  conceptual  analyzer  was  written  bv  Ohrls  °iesheck, 
and  Is  described  In  detail  bv  Flesbeck  (1Q7S).  The  Idea  of 

Implementing  expectations  as  reouesfs  Is  derived  from  bis  work.  A 
later  analyzer  was  Rfesbeck's  Ft. T  (Fnp,llsb  t-angunge  Interpreter^, 
wblcb  Is  described  In  Plesbeck  and  Fcbank  (  1  °7  ^ ) .  Fl.T  Is  a  word-based 
conceptual  analyzer  of  the  same  general  tvpe  as  we  have  been 
describing.  Listed  un  ler  each  word  that  the  svstem  has  In  its 
vocabulary  Is  the  set  of  requests  which  Implement  the  expectations  a 
person  has  upon  reading  that  word  .  Our  Ideas  wre  developed  In  part 
through  experience  with  this  program,  and  with  the  problems  that  arose 
In  Its  use.  Pt.T's  c  npah  1 1  *  1 1  es  were  expanded  hv  the  addition  of  the 
NOP  program  to  handle  complex  noun  groups  and  relative  subclauses. 
NOP  was  written  hv  Anstole  Oershman  and  Is  described  in  Oershman 

(10771. 

The  main  problem  that  we  *ound  w'fb  FL7  Is  simply  that  It  was  too 
top-down.  This  extremely  top-down  orientation  was  a  purposeful 
element  of  the  theory.  1’n *nr t unate  1  v ,  we  found  It  to  he  Inadequate 
for  analyzing  the  kinds  of  complex  Innut  found  ‘n  ordinary  newspaper 
stories.  The  next  two  sections  describe  In  detail  the  theoretical 

problems  that  va»  Identified.  The  third  sertlon  describes  Orsbman's 

NOP ,  which  solved  some  of  these  problems,  ‘’"he  fourth  discusses  some 

general  Implications. 


Pape  16 


S.l  Fl.T's  use  of  top-down  constraints 

In  the  Introduction  of  this  paper,  wo  claimed  that  expectations 
could  he  used  not  onlv  to  connect  structures,  but  also  to  perform 
word-sense  d  1  samhl  pua  1 1  on  .  FLI  Is  an  attempt  to  show  how  requests  can 
he  orpanlred  to  accomplish  that  task.  In  FLI  ,  no  request  listed  under 
a  word  Is  accepted  hy  the  svstem  for  use  In  processlnp  unless  Its 
potential  act'ons  Include  the  hulldlnp  of  a  structure  that  would  mnVe 
the  test  of  some  already  active  request  come  true.  That  Is,  a  request 
from  the  dictionary  Is  activated  onlv  If  the  structure  It  would  build 
satisfies  an  already  exlstlnR  expectation. 

lot's  examine  exactly  how  this  nrocess  works  .  Thr  tests  of  the 
already  active  requests  exist  In  the  form  of  predicates  or 
combinations  of  predicates.  Call  the  set  of  these  predicates  P.  When 
a  word  Is  read  hv  the  system,  rl t  checks  each  request  from  Its 
dictionary  entrv  In  the  follovlnp  wav.  First,  It  finds  the  structure 
that  the  proposed  request  would  build  If  Its  test  became  true.  Then , 
It  checks  th.it  structure  with  each  of  the  predicates  from  the  set  P. 
If  anv  of  them  returns  thr  value  TFtT.,  the  new  request  Is  activated 
for  potential  use.  Otherwise,  It  Is  discarded.  In  this  vav,  Fl.I 
aut nnat 1 r a 1 1 v  chooses  amonp  the  requests  associated  with  a  word,  and 
onlv  selects  those  that  Its  current  pxrert.it  Inns  Indicate  mlpht  he 
re  1 evanf  . 

fnfor tunatrl v,  this  d 1 samhl rua f Ion  mechanism  makes  TLT  Inflexibly 
top-down.  The  system  cannot  use  anv  processlnp  knowledpr  (In  the  form 
of  new  requests)  that  If  cannot  t*e  to  Its  prior  expert  at  Ions.  This 
necessitates  stnrt'nr  the  concrptua1  analysis  process  w* t h  some 
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standard  initiating  requests  at  the  hep, inning  of  enrH  new  sentence. 
However,  In  the  course  of  processing  later  clauses,  these  Initiating 
requests  are  either  inappropriate  or  unavailable.  For  example, 
consider  the  following  sentence: 

A  I. Iberian  tanker  ran  aground  off  Nantucket  Island 
vesterdav,  the  Toast  Coard  said. 

In  attempting  to  analvre  this  sentence,  Fl.l  has  difficulty  with  the 
second  clause,  because  there  are  no  expectations  for  anything  beyond 
the  first.  The  problem  arises  because  Fl.l  '  s  disambiguation  algorithm 
does  not  activate  a  request  unless  it  will  build  a  structure 
satisfying  an  outstanding  expectation.  Hence  if,  as  in  this  example, 
there  are  no  outstanding  ex  pec  t  a  t  1  or.s  ,  no  requests  can  be  activated. 
The  requests  associated  with  the  words  "the  Coast  Cuard  said,"  are 
sf mpl v  1 gnored  . 

!  s  Inflexibility  tlso  mabes  It  Impossible  for  Fl.l  to  postpone 
nak'ng  decisions.  por  example,  Fl.l  could  choose  tKe  correct  sense  of 
"not"  in  each  of  the  following  sentences: 

(1)  John  broke  the  pot. 

(?)  lohn  smoked  the  pot. 

Ip  the  first  sentence,  "h’-nke"  creates  an  expectation  for  something 
which  can  be  broken.  The  d i sar b i gra t i on  algorithm  uses  this 
expectation  to  activate  the  request  which  builds  the  "container"  sense 
of  "pot",  and  reieef  the  one  wMc^-  builds  the  "mar i  luan.a"  sense. 
However,  In  the  second  sentence,  "smoked"  creates  an  expectation  for 
something  which  can  be  so  <ngcs*ed,  which  is  then  used  to  choose  the 
"mnriluana"  sense. 
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Rut  Fl.I  would  not  he  able  to  d * snnblgua te  "pot"  In  the  passive 
forms  of  these  spnfcnres: 

(l'l  The  pot  was  broken  bv  .lobn . 

(2‘)  Tbe  pot  was  smoked  bv  John. 

Its  failure  here  Is  due  to  tbe  fact  that  at  the  time  the  word  "pot"  Is 
read,  there  are  no  semantic  ex  per t a f 1  on s  which  can  be  used  to  choose 
among  tbe  differing  wo  rd  senses.  Recause  FLT  '  s  d  1  sambleuat  Ion 
algorithm  only  uses  prior  expectations,  It  cannot  postpone  deciding 
among  the  requests  associated  with  "pot"  until  later  In  the  sentence, 
when  the  rrnpor  semantic  expectations  are  available  to  perform  the 
d 1 sambiguat Ion .  Nor  does  It  save  anv  discarded  possibilities  In  case 
thev  should  prove  useful  later  on. 

R . ?  Fils  Rho r f  term  r emor v 


UV  mentioned  above  that  FI.l  remit  res  a  set  of  standard  Initiating 
requests  at  the  start  of  a  sentence.  This  necessity  Is  also  related 

to  the  structure  of  the  program's  short  term  memory.  FL1 ' s  analysis 

process  starts  with  a  three  Item  short  term  memory.  One  of  these 
slots  Is  the  p1 ace  where  all  pew  cnceptual  structures  are  placed  when 
built,  called  the  1 n  put  gap.  The  other  I  vn  are  essentially  the 

"suhlect"  and  the  "top-level  concept"  slots.  -rhcse  two  slots  are 
*  *  1  1  rd  bv  t  vo  standard  'nitlatlng  requests  which  fake  structures  from 
the  Input  gap.  Once  these  two  slots  are  filled,  they  cannot  be 

changed  except  bv  use  of  arbitrary  11RF  rode  In  the  requests.  Th's 
essentially  leaves  Fl.T  with  a  working  short  term  memory  capacity  of 
only  one  item,  which  is  insufficient  for  noun  groups  and  many 
multi-clause  con  s' r nr 1 1  on s .  For  example,  rops'der  again  the  sentence: 
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A  1, Iberian  tanker  ran  aground  off  Kanturket  Island 

yesterday,  the  Toast  Guard  said. 

Fven  if  the  requests  associated  with  the  words  of  the  second  clause 
("the  Toast  Cuird  said")  were  accented  for  processing,,  the  limitations 
on  short  term  memory  would  prevent  a  correct  analysis.  Por,  the 
representation  of  "Toast  Guard"  would  be  placed  in  the  one  remaining 
^'rvt  slot,  hut  then  written  over  and  lost  when  the  representation  for 
"said"  vis  placed  there  in  the  next  cycle  of  the  system. 

A. d  Voun  g roups 

As  us*  pointed  out  above,  Ft. I  did  not  process  noun  groups  or 
relative  subclauses  itself.  These  were  handled  bv  Gershman's  VGP 
program.  NTf  necessarily  has  a  far  more  flexible  short  term  memory, 
consisting  of  a  modifie4  stack.  To  understand  vhv  this  more  flexible 
short  term  mcmnrv  is  necessary,  consider  trving  to  ana  vre  a  noun 
group  like  "blue  car  seat".  If  on! v  a  one-item  working  short  term 
memory  were  available,  then  tbe  representation  for  "car"  would  be 
overwritten  bv  the  representation  for  "seat",  and  hence  lost, 
llnwver ,  S’TP '  s  use  of  i  modified  stack  rTX'  can  handle  this  quite 
r  a  s  i  1  v . 

When  ana lvring  a  wo  -d  ‘  o  torn-  noun  group,  VGP  creates  a  new  node, 
and  then  pushes  it  onrn  the  stark  which  constitutes  the  program's 
short  term  memory.  The  conceptual  structure  associated  with  the  word 
's  placed  in  that  node,  an4  anv  new  requests  are  activated  bv  being 
put  on  f he  property  list  of  that  node,  Tersbman  makes  a  distinction 
betvmen  "forward"  reouests,  which  look  one  node  to  the  right,  and 


"backward"  requests,  which  loo1-  one  node  to  the  left 


In  anv  one 
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cycle  of  NOP,  the  onlv  requests  which  are  considered  are  the 
"backward"  requests  associated  with  the  top  node  In  the  stack,  and  the 
"forward"  requests  associated  with  the  nex t - to- 1 he- 1 op  node. 

S.4  Criterion  of  flexibility 

Oir  experiences  with  the  problems  that  a  too  Inflexibly  top-down 
control  structure  can  cause  led  us  to  formulate  the  criterion  of 
flexibility  which  was  stated  In  section  1.0; 

A  conceptual  analvrer  must  possess  the  flexibility  to 
alternate  between  top-down  and  hot  tom-up  processing  as 
warranted  by  the  situation. 

Tills  means  that  the  analyzer  must  he  able  to  use  expectations  wher 
they  ire  available.  But  If  no  helpful  expectations  are  available,  the 
system  must  also  he  able  to  accept  and  save  concepts  and  requests  from 
the  Input  until  some  later  time  when  they  can  he  used.  In  our 
conceptual  analyzer  as  so  far  described  the  C-LIST  and  R-LTST  provide 
this  flexibility.  In  section  0  ue  will  discuss  some  solutions  to  the 
problem  of  word-sense  amhlttuitv  which  do  not  vlo’ate  the  criterion  of 
f  1  ex  I  h  1 1  1 1  v  . 

h.P  TV  r*"rMl 

The  purpose  of  this  section  Is  to  provide  further  details  about 
requests.  We  w<  1  1  describe  the  kinds  of  tests  and  actions  that  we 
found  to  he  necessary  to  accomplish  conceptual  analysis,  d’scuss  vf'v 
they  ire  necessary,  an'*  the  situations  in  which  fbev  are  useful  . 


Page  ?1 

h.  !  R"'ourst  actions:  adding  structures  to  f-l.IST 

Let  us  reiterate  the  actions  which  a  request  mav  perform: 

(1)  Add  a  conceptual  structure  to  the  C-LIST; 

(2  '  Fill  a  cap  (  f  .e . ,  slot!  in  a  conceptual  structure  with 
some  other  structure; 

(11  Activate  other  requests; 

(A  1  De-act Ivate  requests.  Including  in  particular 
t  hemse Ives. 

There  Is  no  restriction  that  a  request  perform  only  one  of  these 

actiors.  However,  the  convention  that  a  reouesf  mav  only  add  one 
structure  to  the  r-l.TR-e  <s  important  for  the  purpose  of  destgning 
word-«tnse  d i saah igua t i on  algorithms,  and  we  have  adhered  to  it. 

('’his  will  he  explained  'n  section  R .  )  As  stated  before,  structures 
are  always  added  to  the  end  of  the  r-LT<'"r. 

h  .  ?  Cap-fill ing  requests 


Conceptual  structures  represented  as  case  frames  are  connected 
w^en  ope  f'lls  t  nap  f'.e.,  s’  o t 1  in  the  other,  or  both  fill  a  gap  in 
some  larger  structure.  Pequests  wMc!  fill  gaps  can  perhaps  he 
thought  of  >s  movtnp  concertea’  structures  ‘rn*  one  place  to  another. 
IV  *  ^  pe  r  s  pe  ctive  sup  n  r  st  s  that  em  bed  de  1  concept  ua  1  oh  fee  t  s  are  removed 
from  pi ib! 1 c  v*ev,  nresurahlv  hv  actually  removing  them  from  the 
r-l,T<t".  tv  1  s  Is  how  our  program  currently  worVs  .  This  decision  was 
motivated  hv  our  view  of  tv,i'  C— l.  1ST  as  l'terallv  a  V*nd  of  short  term 
memorv.  v' th  I’m* • at  inns  or  its  storage  capacitv.  A  positive 
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sHr-cffict  of  tMs  1  s  to  speed  up  search  of  tbp  f'-L,TS‘r. 

We  cap  ch.irac  teri  re  pap-fllllng  requests  In  rou»Hv  two  wavs. 
Fit  her  the  request  knows  which  i>,ip  it's  trying,  to  fill,  an4  is  looking 
for  .1  filler,  or  4 1  knows  rhe  filler,  and  is  1  ookl  nc  for  the  proper 
gap.  Bequests  of  the  tirst  t  vne  are  looking  for  some  structure  in 
order  to  rnbel  it  in  .mother .  Ve  have  already  seen  nuneroos  examples 
of  this  t  vpe  o4  gap-filling  request  in  t^e  previous  examples.  These 
requests  mav  a  r i se  in  two  wavs t 

(11  Thev  i.iv  he  activated  hv  the  reouest  wh  i  c  h  hui  1  t  the 

conceptual  structure  containing  the  pap  thev  strive  to  fill. 

(21  Thev  uv  he  brought  in  hv  'nnr'lon  words  (c.g.  "to"). 

Tap-fill  inc  rogues'*  arising  fror  function  words  are  par  t  i  evil  nr  1  v 
important  in  that  1  f  ^  request  activated  hv  i  function  word  seeks  to 
Mil  some  gap  with  i  structure,  it  must  he  all  owe4  to  do  so.  ,4  the 
gap  is  already  f  i  1  1  o-4  hv  some  other  structure,  that  structure  should 
he  returned  to  the  C-LTBT.  For  example,  consider  the  sentence  ".John 
gave  'in  r  V  to  the  ^he !  k  of  Abracadabra,”  (see  Vilk*  (1®7S)).  After 
eeadipp  "  Tohn  gave  4"arv  ..."  ou>-  conceptual  itna'vrer  would  assume  “arv 
to  he  the  rerip'ent  of  the  giving  action,  and  put  together  a 
represen»i{<on.l  st  rue  t  lire  something  ’ike  (  AT®  A  VB  ATT^B  (  1 0  it  y  )  OR  .TFT  T 
(STL)  Tn  ( *'AB  y )  FPo»<  (JOHN*)).  however,  the  function  word  "to"  clearly 
marks  rhe  ci  *  v  as  the  recipient,  an4  that  explicit  marking  has  high 
priority.  hence,  the  analyzer  would  chanp.c  Its  representation  to 

(4)  'ini'  could  instead  simplv  mark  nhipetc  wh  1  c  h  have  heen  used  to  fill 
gaps  ,  perhaps  with  the  •nforration  as  to  where  thev  ire  embedded,  and 
leave  them  on  the  C-LT^m.  Th 1  s  laf'er  method  is  more  flexible.  In 
that  other  requests  can  selectively  'gnorr  embedded  objects  or  not, 
depending  on  fhe  purpose. 


r«R«-  ?i 


(AT*  A  NS  ACTOR  (JOHN)  nBJFCT  (Nit.''  TO  (SHKIK)  FP^M  (JOHN)).  The 
concept  HAP Y  would  he  returned  to  the  C-LIFT.  and  subsequent  1 v  picked 
up  as  the  ORJFCT  of  the  A ’•PANS. 

As  vs*  pointed  out  above,  there  Is  a  second  t  vpe  of  pap-fi!lin«> 
request  which  knows  the  filler,  and  looks  for  some  structure  <n  which 
to  embed  it.  The  se  usual  lv  i  r  1  se  from  words  that  appear  ip  noun 
croups,  par  tlcul  arl  v  adjectives.  For  example,  the  unnl  "red"  has  an 
associated  request  which  looks  for  the  representation  of  a  physical 
ohlect,  in  order  to  fill  its  COLOR  slot  with  the  structure  PFO.  Th 1 s 
kind  of  cap-fill inp  request  also  arises  from  words  describing  t'se  and 
place  settings.  For  example,  in  the  sentence  "Yesterday,  Fred  bought 
i  .-nr,"  the  word  "yesterday"  has  in  associated  request  v*-ich  looks  for 
a  concept  ,  in  order  to  f'll  its  TJ«f  slot. 

Oace  a  cap  <n  some  structure  is  f '  1 1 ed  ,  all  other  requests  which 
seek  'o  fill  if  should  hi-  removed.  That  ran  hr  handled  in  two  wavs. 
The  simplest  is  to  have  requests  ddrh  seek  to  fill  some  particular 
ear  tes*  whether  it  has  .already  been  filled,  and  if  so  then  remove 
themselves.  Th ' s  is  t'ow  m,r  eurrrnt  implementation  operates.  The 
other  possih'litv  is  to  use  fwo-wiv  pointers  between  paps  in 
conceptual  structures  and  fh#.  requests  which  strive  to  fill  them,  and 
m  place  in  the  control  structure  a  procedure  which  uses  this 
!n*ormat1on  to  remove  unnecessary  requests.  Pieshrrk  s  F 1 . T  uses  tills 
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h.d  Activating  other  requests 

Two  malor  purposes  motivate  our  use  of  requests  to  activate  other 
requests.  First,  ns  vs-  pointed  out  shove,  requests  rhnt  odd  some 
concept  uni  structure  to  short -tern  menory  will  often  net  1  vote  requests 
which  strive  to  fill  gaps  In  thnt  structure. 

Second,  sone  requests  change  the  sense  of  sone  word  In  some  lornl 
context  (see  Vteshecl  nnd  Tchanh  ’T>i  1  s  c nn  he  ncconpllshed  hy 

activating  .1  request,  which,  If  It  sees  the  npproprlnte  word  In  the 
Input,  will  ndd  sone  requests  to  the  dlctlonnrv  entrv  of  thnt  word. 
Function  words  .ire  nn  'npnrt.mt  Inst.ince  of  this  notion  of  local  Iv 
ohang'ng  v»ird  sense,  since  In  nanv  cases  they  function  onlv  with 
respect  to  1  put  Icid  .ir  cons' rue  t  Ion .  Take  the  exnnrle  of  the  word 
"of".  The  re  1  .it  1  onsh  1  p  It  denotes  -*epends  on  the  construction  In 
which  It  ippe>rs.  rye  such  con  s  t  roc  t  1  on  Includes  examples  such  ns 
"five  yards  of  clofK",  or  "ten  pounds  of  tnnrllunnn".  A  good  wav  to 
handle  t *- 1  s  construction  Is  to  have  a  request  which  is  associated  with 
the  "unit"  sense  of  words  such  as  "yards"  and  "pounds".  This  request 
Is  activated  hv  r  h0  reeuesf  which  ad's  the  "unit"  structure  to  the 
When  ac'tye,  the  rrnuesf  c'-ecks  to  determine  whether  or  rot 
the  next  word  Is  "of".  ’ '  If  Is,  then  the  request  activates  another 

reeuest  which  looks  for  a  physical  ohlrcf,  and  when  found  attaches  the 
description  created  hv  "five  vards"  or  "ten  rounds"  to  It. 

In  general  ,  local lv  changing  the  sense  o'  some  vmrd  in  this 
manner  does  not  Involve  throwing  out  whatever  requests  are  indexed 
dlrectlv  under  the  word,  lust  augmenting  them.  In  this  wav,  If  the 
new' v  activated  requests  should  fall  to  he  applicable,  then  all  of  the 
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usual  requests  assoc  iated  with  the  word  are  still  available  to 
continue  processing.  However,  the  specially  added  request  needs  to  he 
(tuaranteed  prioritv  over  the  usual  requests  associated  with  the  word. 

h.4  'V-ar 1 1  vat  ! nf  requests 

'rhe  ftnal  request  action  Is  the  ahil'tv  to  de-activate  requests. 
f>ne  important  use  of  this  action  is  to  have  requests  de-activate 
themselves  under  certain  rirnmit.inres.  In  this  wav,  a  request  which 
notices  that  it  Is  no  lonper  appropriate  ran  remove  itself  before 
foul 'or  up  'he  analysis.  For  example,  consider  the  request  for 
locallv  extending  the  senses  of  the  word  "of",  described  in  the  last 
sect'on.  !f  rhe  next  word  's  not  "of",  t^en  this  request  must 
de-activate  (,se’f.  Otherwise,  <f  "of"  occurs  later  in  the  input,  the 
request  vrvul  d  chance  <ts  mraninp  ‘n  a  way  which  is  no  lonper 
j ppropr  !  ife, 

Another  situation  'n  vMrh  this  action  is  useful  occurs  when 
t*ere  m  several  request®  w*-  '  r  *  represent  rompetlnc  *-vpnth*»«e«  lhout 
the  —canine  of  a  word.  The  request  which  represents  the  correct 
me.aninp  (however  chosen),  must  de-act'vate  f he  other  requests.  (We 
v*  ’  1  return  to  rK1s  In  section  Q  ,  w'’ich  discusses  the  problem  of 
imh i  pe1 tv.) 

h.S  Tests  of  renucsts 

As  we  discussed  In  section  1  above,  the  tests  o*  requests  pxflnhiP 
either  the  actual  words  of  the  Input  text,  or  tbo  ohlncts  on  the 
r-LT*T.  We  have  at  this  point  d i st inpul  shed  tm  variants  of  the 
latter: 
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(I)  Searching  for  the  occurrence  of  some  structure  on  the 
C-UST  with  the  correct  properties; 

(?)  Testing  whether  or  not  certain  Raps  In  some  structure 
are  filled. 

Clenrlv  the  properties  with  which  tests  of  t vpe  1  are  concerned  will 
often  he  conceptual  or  semantic.  For  Instance,  one  mlphf  write  a  test 

like  "Is  there  a  PP  on  the  C-L1<'T'’",  or  "Is  there  a  PP  on  the  f-l.TST 

whir*'  Is  a  higher  an  lmat  e’ " .  We  have  seen  these  sorts  of  tests  In  the 
examples  discussed  previously.  Put,  these  tests  may  also  have 
constraints  on  where  In  the  C-L1ST  they  should  look,  such  as,  for 
example,  an  Instruction  to  look  only  on  the  end  of  the  C-LIST,  or  to 
search  onlv  preceding  or  following  some  other  ohlect  on  that  list. 
Such  constraints  are  on"  wav  of  utilizing  the  structural  Information 
derived  from  word  order.  In  nt*'er  words,  these  constraints,  which  can 
he  expressed  hv  predicates  In  the  test,  embodv  expectations  related  to 
sentence  structure  rather  t*vxn  content. 

These  cxrert.it  ion*  whir*'  embody  svntart*r  knowledge  are  necessary 
whenever  there  are  several  gaps  in  a  representational  structure  which 
have  the  same  semant'c  requirements.  For  example,  hoth  the  *<~TOP  and 

the  TO  slots  of  an  ATRAFS  can  appropriately  hr  tilled  hv  l  "higher 

anlnacp".  Syntactic  knowledge  must  then  he  used  to  decide  which  of 
several  appropriate  gaps  a  structure  should  fill.  f>ir  conception  of 
syntax  is  "-ore  ful  1  v  explained  in  section  °.l. 

hro  predicates  were  found  useful  in  constraining  where  on  the 
C-UST  to  look:  (1)  a  predicate  which  tests  whether  or  not  one 
structure  precedes  another  on  the  C-1.1ST;  and  (?)  a  predicate  which 
tests  whether  or  not  on"  structure  follows  another  on  the  r-l.ism.  We 
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have  also  already  shown  examples  of  this  sort  of  test.  In  section  1 
above.  In  the  example  given  there,  the  ATRANS  sense  of  the  word 
"give”  activated  the  following  request: 

RF.OUEST  — 

TFST:  Can  von  find  a  human  on  the  C-t.IST 
preceding  the  A  fR  A  VS  structure1 

AXIOMS:  Put  it  In  the  ACTOR  and  FPOM  slots 
of  the  AT® A VS 

The  type  ?  test  in  the  above  scheme  reflects  another  possible 
method  for  utilising  word  order  Information.  Rather  than  depending  on 
the  order  of  objects  In  the  C-1.1ST,  the  determination  of  which  of 
several  unfilled  pans  some  candidate  structure  should  fill  could  be 
based  )n  part  on  constraints  In  the  order  In  which  those  Raps  should 
be  filled.  The  so  constraints  are  expressed  bv  having  tests  which 
chech  to  see  whether  or  not  some  gap  Is  filled.  For  example,  suppose 
wo  wanted  to  write  ,1  •  request  to  fill  the  "no  slot  of  an  ATRAVS  arising 
from  the  word  "give",  because  the  same  semantic  constraints  app'v  to 
r Far*  AOTfAR  ini  TO  slots,  we  need  a  trSf  to  distinguish  between  them. 
Since,  in  in  active  sentence,  the  ACTOR  will  be  seen  before  the 
recipient  Is  so.-n  ,  the  following  request  will  Insure  that  the  To  slot 
Is  not  Incorrectly  filled  v*th  .a  structure  that  ought  to  fill  the 
ACTOR  slot : 

RFOfJFST  — 

TFST:  Can  vou  find  a  human  on  the  C-L1ST,  and  Is  the  ACTOR 
slot  already  filled1 

ACTIONS:  Put  <t  in  the  TO  slot  of  the  ATRAKS. 
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b.h  Searching  the  C-LIST 

An  ordering  problem  arises  In  conceptual  analysis  when  tbe  test 
of  a  concept ua 1  -  level  request  Is  searching  the  C-LIST  for  some  object 
with  certain  properties.  If  more  than  one  Item  on  tbe  C-LT^T 

satisfies  the  test,  how  can  the  system  choose  between  them1  Let's 
examine  tbe  following  fragment:  "The  girl  Fred  saw  In  the  park  . . 
The  request  activated  bv  reading  "saw"  activates  another  request 
looking  for  an  animate  actor.  But  there  are  two  possibilities,  "tbe 
girl"  and  "Fred".  In  cases  like  this,  we  use  a  recency  rule  to  select 
from  among  several  possibilities.  That  Is,  when  scanning  the  C-LIST 
looking  for  some  object  which  satisfies  certain  predicates,  the  system 
should  look  at  the  more  recently  added  oblects  first. 

7.0  CONTROL  ‘'TFl’OTl’RF  TN  VORF  OFTAIL 

So  far,  w<>  have  not  elaborated  much  on  the  control  structure 
described  In  section  1 .  Tbe  purnns"  of  this  section  Is  to  provide 
further  details  about  the  control  structure  o f  a  conceptual  analysis 
algorithm,  and  to  describe  the  reasons  which  motivate  that  control 
st  rue  t  ure  . 

7.1  Organising  requests:  the  recenev  rul e 

A  laree  part  of  the  theory  of  conceptual  analysis  Is  the  problem 
of  request  orphan  1  rat  1  on  ,  which  Is  related  to  controlling  bow  and  when 
recuesfs  get  considered.  We  have  supposed,  rather  si mpl 1 st ic al 1 V , 

(S)  Similar  control  questions  arise  In  all  production  systems.  For  a 
good  overview,  see  Oavis  and  King  (1°7S).  tv,*,  central  problem  Is 

determining  which  control  strategies  are  appropriate  to  which  domains. 
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that  active  requests  are  held  In  some  list,  the  P-LTST.  Now  consider 
the  following  example  sentence:  "Saul  ate  a  big  red  apple."  Our 

Intuition  is  that  the  adjectives  preceding  the  word  "apple"  have  a 
chance  to  modify  the  concept  "APPI.*-"  before  the  resulting  concept  is 
used  to  fill  the  INPEST  frame  added  to  the  T-LTST  by  "ate".  It 
appears  that  the  requests  activated  hv  those  adjectives  are  considered 
before  the  requests  activated  when  the  INCEST  structure  was  added  to 
the  C-I.1ST.  Fxamples  like  this,  and  others  as  well,  have  led  us  to 
adopt  a  rule  of  request  rec  one v .  (Pules  of  this  sort  are  common  in 
production  systems.!  Thls  rule  states  that  requests  are  considered  in 
reverse  order  of  the'r  activation,  from  most  recent  to  least.  In 
addition  to  guaranteeing  that  the  analysis  proceeds  according  to  our 
Intuitions,  this  is  a  good  heuristic  principle,  since  newer  requests 
represent  newer,  and  so  possihlv  better,  information  about  what  might 
he  polnp  on  than  older  requests. 

!>et's  look  at  another  example:  "Pred  told  John  Pill  hit  Varv." 
When  "fold"  is  read,  a  request  is  activated  which  adds  a  conceptual 
structure  to  t>-o  f-l,TP'r,  roughly  something  like  (“TBANN  APTop  (NIL) 
vob.TEPT  (NIL)  To  (NIL!).  Tn  addition,  requests  are  activated  vhlch 
trv  to  fill  the  empty  slots  in  this  frame.  One  of  these  requests  Is 
looking  for  a  concept  to  put  In  the  “OBJECT  slot.  Then,  when  "hit"  is 
read,  a  request  Is  activated,  which  adds  the  conceptual  structure 
(port*  l  ACT™  fNTL)  OPJrCT  (NIL))  to  the  C-1.1PT. 

This  request  also  activates  some  new  requests  to  try  and  fill  the 
empt v  slots  in  the  pgopEL  frame.  Fven  though  the  system  has  already 
commenced  scanning  the  list  of  active  requests,  these  new  requests  are 
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now  the  most  recent.  The  process  could  simplv  make  a  note  that  new 
requests  have  been  activated,  an'*  continue  checking  the  older 
requests.  Tills  corresponds  roughly  to  a  "breadth  first"  consideration 
of  requests.  A  strict  interpretation  of  the  recencv  rule,  however, 
leads  us  to  postulate  that  request  cons  1 dera t Ion  is  more  "depth 
first".  That  is,  newly  a-tivated  requests,  being  the  most  recent,  are 
considered  immediately.  Coing  back  to  our  example,  this  guarantees 
that  the  requests  which  strive  to  fill  gaps  in  the  PROPFL  frame  are 
considered  before  the  requests  which  strive  to  fill  gaps  in  the  MTPANS 
frame.  Hence,  "Pill"  is  used  to  fill  the  »CT<’’R  slot  of  the  PROPEL 
before  the  resulting  structure  Is  used  to  fill  the  f'PBJFOT  slot  of  the 
MTRANS. 

In  many  cases,  more  than  one  request  is  activated  at  a  time,  and 
hence  these  requests  have  the  sane  recency.  Since  requests  are 
considered  in  order  of  recencv,  requests  activated  at  the  same  time 
should  he  clearly  marked  ns  such.  A  set  of  requests  activated  at  the 
same  time,  and  hence  having  the  same  recency,  is  called  a  request 
pool.  Thus,  In  order  to  implement  the  recencv  rule,  our  program  uses 
an  ordered  list  of  request  pools,  each  pool  containing  one  or  more 
requests.  Section  7.1  will  discuss  request  organisation  v4fhin  pools. 

7.7  An  alternative  to  the  recencv  rule 

The  main  import  of  the  recencv  rule  seems  to  he  that  if  a 
conceptual  structure  A  is  going  to  he  used  to  fill  a  g.ap  in  some  other 
structure  P,  then  before  A  is  embedded  in  P,  A  is  given  a  chance  to 
f’ll  *ts  own  gaps.  Tonsider  again  the  example  of  the  last  section. 
He  fore  the  P»rPFl  structure  Is  embedded  in  the  ‘'TRANS,  "Pill"  Is  aised 
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to  fill  the  ACT'’”!  slot  of  the  PRopfi.,  In  processing  terms,  this 
effect  of  the  recency  rule  can  he  expressed  as  follows:  If  requests 

which  assemble  and  modify  lower  level  structures  and  requests  which 
assemble  these  suh- st rue t ure s  Into  higher  level  structures  are  active 
at  the  same  time,  then  the  former  have  priority  over  thp  latter. 
Taking  this  formulation  as  our  main  principle  of  request  organisation 
seems  to  lead  to  equivalent  order  of  processing,  bait  a  completelv 
llfferent  algorithm.  The  most  obvious  Implementation  of  this 
principle  Is  as  follows: 

(11  '■'oHecf  all  requests  with  true  tests,  without  evaluating 
anv  actions. 

(?1  ^rdcr  these  requests  so  that  n  request  has  an  action 
wh'ch  uses  some  structure  to  fill  a  gap,  apv  requests  which 
w»nt  to  change  that  structure  or  flll  a  slot  In  It  are  p*vrn 
flrsr  prlor'tv. 

(dl  rxecute  the  requests. 

Mir  program  currently  us"s  the  recencv  rule,  since  It  Is  easier  to 
*mpl  ement  . 

Request  organisation  within  pools 

The  next  question  *s,  hov  are  requests  organised  within  pools’  A 
certain  amount  of  hierarchy  Is  clear’v  neccssarv,  since,  as  we  noted 
*n  the  previous  section,  requests  speciMcallv  added  to  change  the 
sense  of  a  ward  in  some  local  context  must  he  guaranteed  priority. 

Tn  addition  to  this  hierarchical  organl  s.at  ion,  requests  are 
organised  within  pools  according  to  the  actions  they  perform.  For 
example,  suppose  that  several  requests  *n  the  same  pool  all  have  among 


their  actions  adding  some  structure  to  the  f-LTST,  and  suppose  further 
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that  wore  than  one  of  these  has  a  true  test .  Thls  Is  how  word-sense 
ambiguity  would  manifest  Itself  In  a  conceptual  analyzer,  and  the 
nrohlew  Is  to  select  the  correct  request.  Thus ,  the  algorithm  which 
controls  request  consideration  must  not  onlv  order  the  requests.  It 
must  sometimes  choose  among  them.  If  It  were  unahle  to  make  such  a 
choice.  It  might  even  prevent  anv  of  some  ser  of  competing  requests 
from  being  executed.  In  section  Q,  we  will  return  to  the  question  of 
how  the  algorithm  which  controls  request  consideration  might  be  ahle 
to  choose  among  requests  In  cases  of  word-sense  amhlgultv. 

7. U  Noun  groups 

An  ir.il  vrer  implemented  along  the  l'nes  wo  have  described  up  to 
now  would  have  great  difficulty  processing  noun  groups  with  more  than 
one  noun  correctly.  The  problem  is,  it  Is  possible  that  a  concept 
will  incorrectly  use  some  intermediate  conceptual  structure  to  fill  a 
gap.  For  example,  consider  the  sentence  "Ceorge  sat  on  the  stairway 
handrail."  The  conrept  representing  "sat"  presumably  has  an  empty  slot 
for  the  object  upon  which  the  actor  was  sitting,  and  a  request  which 
tries  to  fill  that  slot  Met  us  agree  to  call  it  the  PB.T^CT  slot). 
Since  a  stairway  is  a  perfectly  fine  object  to  sit  on,  the  algorithm 
as  described  up  to  this  point  would  allow  that  request  to  fill  Its 
slot  with  "stairway",  before  the  entire  noun  croup  had  been  analyzed. 
So,  the  problem  Is  to  somehow  prevent  anv  request  strlvlnp  to  fill  the 
OBJECT  slot  from  firing  prematurely,  or  correct  the  situation  If  that 
should  happen.  It  Is  clear  that  when  analyzing  noun  groups  the 
control  structure  must  consider  requests  in  some  manner  different  than 
so  far  described.  Our  prohl em  Is  oner  again  one  of  controlling 
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request  considerat  ion . 

To  Kindle  this,  we  use  the  following  procedure  for  request 
eons t dera t ! on  In  noun  groups:  Consider  onl v  the  requests  associated 
with  each  Incoming  word  1  .e .  t  be  most  recent  request  pool)  until  the 
end  of  the  noun  group,  when  processing  returns  to  normal  ( 1  .e  . 
considering  all  requests  starf'ng  with  the  mosr  recent  pool).  That 
Is,  If  the  program  Is  In  this  noun  group  mode,  and  a  new  word  Is 
Input,  then  onl  v  t  hi-  nowl  v  activated  requests  associated  with  that 
word  ire  considered  .  Trior  requests  are  not  considered.  The  reader 
should  note  that  use  of  th's  algorithm  depends  on  ordering  the 
’■pquests  hy  rorrn'v, 

I'sing  this  changed  procedure  for  noun  grotins,  the  entire 
structure  representing  "stairway  handrail"  would  he  constructed  before 
the  request  vh  1  c v-  strives  to  f,l'  rv'e  pn  met  slot  of  the  s'rtlng 
action  could  he  ronsidered. 

■""Ms  pro'-edure  for  controlling  request  conslderat  ion  has  the 
additional  effect  of  Insuring  that  the  head  noun  of  the  noun  group  Is 
d'seovered  before  ad  lectlves  are  attached.  For  evample,  consider  how 
this  algorithm  would  ana'vge  the  input  "hlue  car  seat".  First  the 
request  associated  with  the  word  "blue"  would  hr  activated.  Such  a 
request  would  str've  to  fill  the  PPl.Ot?  slot  of  some  physical  object  to 
the  r'ghf.  Next,  the  request  associated  with  the  word  "car"  would  add 
a  structure  to  the  P-1. T ST  representing  the  concept  of  automobile. 
However,  since  the  analyzer  Is  In  noun  group  mode,  the  prior 
expectation  from  "hlue"  would  not  he  ronsidered  at  tMl  time. 
Finally,  the  word  "seat"  *s  read,  and  another  structure  is  added  to 
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the  C-LINT.  Now,  onlv  after  the  structure  represent  lng  "ear  sear"  <s 
bull  r  ,  would  the  request  associated  with  "Mix’"  hr  considered.  It 
would  then  ascribe  the  attribute  of  being  colored  blue  to  the  seat  , 
not  to  the  car.  Under  certain  circumstances,  of  course,  this  could  be 
wrong ,  e.R.  "red  stairway  railing"  might  refer  to  the  railing  of  a 
red  stairway,  Instead  of  the  red  railing  of  a  stairway.  We  believe 
that  a  general  solution  to  problems  of  this  kind  will  depend  on  better 
understanding  of  the  role  of  memory  In  parsing.  however,  as  we 
pointed  out  above,  the  process  described  here  does  have  the  virtue 
that  it  allows  noun  groups  to  he  completed  before  the  resulting 
analysis  *s  used  in  larger  structures.  For  example,  if  the  phrase 
"blue  car  seat"  Is  embedded  in  the  sentence  "Ceorgo  sat  on  the  blue 
car  seat ,"  then  the  analysis  would  determine  that  Ceorge  sat  on  the 
seat,  not  on  the  car. 

In  order  to  use  the  process  ve  sketched  out  above,  an  analyzer 
must  he  able  to  determine  vher  It  should  he  In  noun  group  mode  (which 
is,  in  some  sense,  a  "careful"  mode',  and  v*ien  It  shoul  d  he  in  normal 
mode.  We  have  used,  with  slight  mod  1  f  1  c  at  1  on ,  Cershman’s  M°77) 
heuristics  ‘or  determining  noun  group  boundaries.  Nome  o‘  these  rules 
depend  on  conceptual,  and  some  on  syntactic,  knowledge. 

P.f  gewr  a-ycfanv-r  jcm  tcgpcc 

In  this  section,  ve  will  address  some  o‘  the  theoretical  concerns 


which  motivated  our  work 


w.l  The  role  of  svnt.ix 


In  our  discussion  to  this  point,  we  hove  re  pen t od 1 v  emphaslrcd 
that  the  analysis  process  should  use  anv  available  knowledge  which 
might  he  helpful.  Including  knowledge  of  syntax.  The  reader  nay  at 
this  point  he  wondering  exactly  what  role  syntactic  knowledge  has  In 
conceptual  analysis,  and  how  It  is  used.  Traditional  notions  of 
syntax  Include  ideas  l'kr  "purr  of  speech"  and  "phrase  marker"  In 
discussing  the  structure  of  a  sentence.  What  we  would  like  to  claim 
In  tb's  section  Is  that  these  norions  of  syntax  are  inappropriate  wdien 
attempting  to  describe  and  of  1 1  1  re  syntactic  knowledge  in  a  language 
analysis  process. 

To  begin  with,  whit  ( n  the  purpose  of  syntactic  knowledge’ 
Clearly,  a  malor  use  of  syntactic  knowledge  is  to  direct  the 

combination  of  word  'c.inlnp*;  ‘nto  utterance  meaning  whon  semantic 
information  *s  not  sufficient.  For  example,  (n  an  utterance  like  "Put 
the  magazine  on  the  plate,"  it  is  syntactic  knowledge  that  tells  the 

understander  which  ohferf  ' s  »n  he  p!accJ  on  top  of  which.  From  the 

point  of  view  of  its  use  in  a  ronreptuo’  analyzer,  therefore, 

^  large  parr  of  syntax  is  knowledge  of  how  to  combine  word 

meanings  based  on  their  positions  in  the  utterance. 

How  can  th's  syntactic  knowledge  he  c ha r ac f e r 1  ted ’  We  seek  a 
spec  1  f  1  c  at  i  on  which  takes  *ntn  account  the  fact  that  r*e  po‘nt  of 
syntax  is  its  vise  *n  the  understanding  process.  Ur  have  viewed  the 
process  of  understanding  as  ope  of  connecting  representational 

sf rue f  'ires ,  where  a  connection  has  been  established  between  structures 


when  one  fills  a  slot  in  the  other,  or  both  fill  a  larger  form.  Thus 
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syntactic  knowledge  Is  knowledge  which  sper4fies  where  In  the 
utterance  some  won!  Is  to  he  found  whose  meaning  can  be  connected  (via 
s lot - f 1 1 1 Ing )  with  the  meaning  of  another  word.  Pf  course,  we  must 
now  specify  the  notion  "position  In  an  utterance". 

In  section  h.S,  We  discussed  how  know' edge  about 

( 1 1  Relative  poslt'ons  (n  short  term  memory,  and 

( ^  )  The  order  In  which  slots  In  structures  should  hr  filled 
could  he  used  In  the  tests  of  requests.  Roth  of  these  methods 
describe  position  In  an  utterance  hv  use  of  relative  positional 
Information.  The  first  of  these  methods,  us'np  re'atlve  position  In 
short  term  memory,  describes  the  poslt'on  of  a  conceptual  structure  In 
direct  relation  to  the  other  structures  't  might  hr  connected  with  via 
si  o  t  -  f  *  1  1  Ins  .  "rve  secon'1  method,  ordering  of  the  slots  to  he  filled, 
relates  the  position  o<  i  srruefurr  to  other  structures  somewhat  more 


lnd  1  rec  1 1  v  . 

In 

pa r 1 1 c ul nr  ,  hv 

con s ' r  a  t  n i np  the 

order  *n 

vh 1 r  h  slots 
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fl  Med 

,  we  arr  re1 

ipflng  the  fillers  n* 

those  slots 

f  empora  1  1  V  . 

Rut  , 

o  f  pour  sc  , 

when  a  St  rue  t  ure 

her  om  e  s 

aval  1  ah  1 e  Is 

directly  related  to  vhr  r,.  if  appears  In  the  In  put,  l.e.  relative 
position  In  short  term  memory  reflects  the  temporal  order  of  the 
Input.  Roth  methods  are  essentially  wavs  to  utilise  word  order 
1 n  form  at  ton  . 

Another  Important  method  relates  the  position  of  a  conceptual 
structure  to  the  position  of  a  particular  lexical  Item,  l.e.  a 
function  wnrd .  Function  words.  Including  prepositions, 

pos t - no s 1 1 1  on s ,  and  affixes,  are  very  Important  syntactic  cues  In 


language  analvs‘s 
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d .  ?  Prior  syntactic  expectations  unnecessary 

In  our  discussion  of  the  analysis  procedure,  we  have  repeatedly 
stressed  the  Importance  of  flexibility  In  switching  between  top-down 
and  botfom-up  modes  of  nrocesslnp.  This  <s  necessary,  for  example,  In 
order  to  handle  long  raul t 1 -c 1  nine  const ruct tnn«.  Paving  determined 
how  to  achieve  this  flex'hillty,  we  discovered  an  Interesting 
side-effect.  We  found  that  It  was  not  necessary  for  the  analyser  to 
have  any  prior  expectations  at  the  start  of  a  sentence,  such  as  for  an 
Initial  oouta-proun,  or  for  a  complete  sentence.  Most  other  parsers, 
whether  syntax  based  or  semantics  based,  do  use  such  prior 
expectations  at  the  start  of  .a  sentence.  While  we  were  at  first 
unsure  as  to  the  ps  vc  ho  1  op  1  c  al  correctness  of  the  absence  of  these 
prior  syntactic  expectations,  we  now  bel  'ey*-  that  this  Is  in  fact  the 
correct  approach. 

However  ,  there  ,ar«  some  problems  that  might  arise  given  this 
approach.  How  can  v»’  explain  the  weirdress  of  sentence  (l)  below,  as 
opposed  to  sentence  f1'1 

(1)  ^  plane  stuffed  with  1  Si'O  pounds  of  marihuana. 

( "*  1  *  plane  was  stuffed  with  1  t>0O  pounds  of  marlfuana. 

There  Is  a  real  feel*ng  of  " 1 ncom pi e f e ne s*"  In  sentence  (11  which 
would  seem  to  argue  fivat  people  do  have  prior  expectations  for 
COW pi ete  sentences.  However ,  consider  how  these  t  wn  sentences  would 
sound  following  this  Question: 

(d)  What  crashed’ 


Following  Question  (d)t  <t  Is  sentence  (?)  that  sounds  odd ,  while 
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st'nlcnrf  (I)  seems  perfectly  at  home.  Now,  one  could  explain  this 
phenomenon  hy  saving  that  the  expectations  to  he  supplied  at  the 
beginning  of  a  sentence  change,  and  that  after  question  (1),  a  parser 
Is  no  lonper  expTt  'nR  a  complete  sentence.  But  of  course,  question 
(11  could  equally  well  he  followed  by  any  of  the  following: 


(4)  A  plane  carrying  1 S00  pounds  of  marihuana  crashed. 

(5)  Nothing  crashed. 

(6)  Wat  are  vou  talking  about  7 

(7)  There  wasn't  any  crash. 

(R)  I  didn't  hear  anything. 

So  obviously,  a  parser  which  depends  on  an  expectation  for  a  complete 
sentence,  could  not  slmplv  throw  it  out  In  the  context  of  a  ouestlon 
like  (11.  If  It  did,  It  would  then  be  unable  to  handle  Inputs  like 
(4  1  through  ( R ) .  Further,  these  examples  make  clear  that  the  absence 
of  an  expectation  for  a  complete  sentence,  within  the  context  of  a 
question,  cannot  he  the  explanation  for  the  weirdness  of  (2)  in  the 
context  following  (71.  That  can  only  he  explained  hv  reference  to 
higher  level  processes,  such  as  memory  search  and  question  answerinR. 
However,  it  seems  to  vs  that  the  weirdness  of  (11  in  a  null  context  is 
exactly  inaloRous  to  the  we'rdpess  of  (7)  in  the  context  of  ( 7  ) .  And, 
of  course.  It  can  he  explained  hv  exactly  the  same  appeal  to  the 
properties  of  hij.Wr.r  level  processes,  wM  c  h  we  have  seen  is  a  1  ready 
necessarv.  Therefore,  this  phenomenon  cannot  hr  used  as  evidence 
against  our  contention  that  pr’or  syntactic  expectations  for  c.g.,  a 


complete  sentence,  are  unnecessary. 
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We  would  claim,  moreover,  that  the  explanation  #or  the 
svmmet r leal  rases  of  (1)  In  a  null  context  and  (?)  In  the  context  of 
(?),  ought  to  he  the  same.  In  other  words,  the  explanation  underlying 
this  particular  tvpe  of  "grammat ♦cal  1 1 y"  ludgment  does  not  lie  In  a 
synt  ac  t lc  phenomenon  at  all.  Rather,  It  Is  a  phenomenon  which  should 
be  explained  hv  reference  to  such  higher  level  processes  as  memory 
search  an!  question  answering. 

8.1  Learnlnp  conceptual  analysis 

( Hi  r  worV  has  been  s 1 p n 1 f 1 r an t 1 v  affected  hv  developmental 
concerns.  A  theorv  of  conceptual  analysis,  If  It  Is  to  he  taken 
seriously  as  a  ps vr ho  1  op  1 r a  1  theory,  must  ultimately  show  how  the 
process  of  conceptual  analysis  can  he  learned,  starting  from  some 
minimal  base  of  knovledpe  and  procedures  (see  Schank  and  ">1  fridge 
(l°77)  and  cel  fridge  (l0?11)).  It  Is  not  feasible  to  discuss  here  what 
that  base  might  he,  or  what  the  learn<ng,  mechanisms  are.  Rut  It  Is 
appropriate  to  point  out  how  these  cons • derat  1 ons  have  affected  the 
work  described  here.  For  Instance,  our  goal  of  a  simple  control 
structure  is  motivated  hv  more  than  pragmatic  considerations.  The 
less  additional  structure  that  must  hr  proposed,  the  more  the  control 
structure  resembles  t  vr rv  minimal  computational  device.  That  In  turn 
makes  the  problem  of  learning  conceptual  analysis  more  a  problem  of 
learnlnp  tbp  proper  requosts,  which  might  lead  to  more  attractive 
'•rvclarnrPt.il  theories.  For  example.  If  one  asks  a  young  child  to 
"Put  the  table  on  the  doll,"  he  or  she  m'pht  well  respond  hv  putting 
the  doll  on  the  fable.  ( *5rr  ,  for  example,  Poogenraad  et  al  .  (1°7R).) 

If  seems  is  If  the  child  actually  understands  the  utterance  as  having 
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that  (quite  plausible)  meanlnR.  Yet,  an  adult  clearly  understands  the 
actual  meaning,  despite  Its  absurdity.  The  tbeorv  of  conceptual 
analysis  suggests  that  the  difference  displayed  here  between  adult  and 
cbl '  d  language  underst  and  ing  might.  be  a  difference  In  the 
sophistication  of  the  expectations  (  1  .e  . ,  requests)  which  are  used  to 
fill  the  gaps  In  the  care  structure  which  represents  the  meanlnR  of 
"put".  That  Is,  the  tests  of  the  requests  possessed  hv  the  chi  Id  are 
almost  completely  semantics  based,  whereas  those  of  the  adult  are  more 
syntactically  sophisticated.  It  Is  quite  plausible  now  to  hypotheslre 
processes  whereby  those  requests  can  be  changed  by  experience  to 
reflect  the  maturation  which  has  occurred.  A  precise  spec  1 f *  cat  1  on  of 
such  processes  vsnild  constitute  an  Important  part  of  a  theory  of 
language  acquisition. 

P.4  Intelligent  error  correction 

Pecentlv,  some  attention  has  been  focussed  on  the  Idea  of 
deterministic  "wait  and  see"  syntactic  pars'ng,  without  backup  (see 
Warms  f  1  °7  S  )  Y  .  IVtermlnlsm  Is  guaranteed  bv  res'r<rtlnp  the  analysis 
process  so  that  no  structure  ran  he  built,  but  then  later  discarded, 
T^ils  notion  has  been  contrasted  with  the  non-def  e  rm  1  n  I  s  t  1  c  "guess  and 
then  backup"  method  tvpIHed  hv  ATN  parsers.  While  we  are  In  complete 
agreement  with  thr  Idea  that  It  Is  undesirable  to  use  blind  backup  as 
an  Integral  part  of  the  analysis  process  ,  we  hr II eve  that  Marcus* 
notions  of  defrm'nism  Kaye  Ignorrd  the  possibilities  of  what  might  he 
called  "'nfelllpenf  error  correction".  for  example,  let's  look  at  the 
following  pair  of  sentences: 


(1  )  Tohn  gave  *'arv  a  hook. 
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(2)  John  pave  Mary  a  H  ss  . 

In  the  first,  "pave"  should  add  the  following  structure  to  the  C-LIST: 
(ATRANS  ACTOR  (KM.)  OBJECT  (Nil.)  ^0  ( POSSFCC  10N-OF  (Kill)  FPr*> 

( PORNF*^  IPN-OF  (NIL)).  In  the  second,  "pave"  Is  merely  a  dummy  verb, 
and  this  structure  Is  completely  Inappropriate.  However,  It  turns  out 
that  there  are  two  wavs  to  handle  this  problem  In  a  conceptual 
analyzer.  The  first  approach  Is  exactly  the  analogue  In  conceptual 
analysis  of  what  f'arcus  would  call  "waif  and  see”,  namel  v  not  bulldlnp 
any  top-level  structure  until  either  "hoop"  or  "Wlss"  Is  read.  The 
second  approach  Is  "intellleenf  error  correction”.  I'slnp,  this  method, 
the  ATRANN  structure  ‘s  built  *n  borh  cases,  and  the  analyzer  proceeds 
to  f'll  the  empty  yaps  with  appropriate  substructures.  However,  an 
additional  request  Is  activate-*  which  essentially  savs  "If  you  see 
another  r nr p’ efe  concept,  1 .e  .  action  or  state,  rather  than  some  t h  * np 
that  can  fill  the  nbjnrt  slot  nr  in  ATANN,  then  that  Is  the  actual 
top-level  structure.  Pemove  f*>e  A  TUANS  *rm  the  C-1.1ST,  and  flll  the 
empt v  paps  In  the  prv  structure  with  t^e  substructures  wblrb  rap  he 
foun-*  *p  the  A^AN^."  I'slnp  either  of  these  methods,  the 
sub- st r uc t ure s  whirl  have  beep  assembled  alonp  the  wav,  such  as  the 
re  present  At  Ions  for  ".Tobn"  and  for  "I'.irv" ,  ur  still  available,  and 
this  after  all  Is  the  hcv  to  avoldlnp  harV-up.  1's*np  Intel  1  Iprnt 
error  rorrerf'on  mipbt  he  the  better  approarh  In  those  eases  where  the 


Initial  hypothesis  Is  almost  always  correct  (see  Ccrshman  (1°70)) 
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H.O  WOR 0-SrNSF.  mSAMFlCUATlON 

As  w**  pointed  out  In  secflor  7.1  above,  In  conceptual  analysis 
word-sense  ambiguity  manifests  itself  when  two  or  more  requests  of 
equal  recency  (  1  .e  .  ,  In  the  simp  pool,  .in-1  therefore  derived  from  the 
same  word)  have  among  their  actions  adding  structures  to  the  T-LIST. 
How  can  ve  Insure  that  the  structure  representing  the  correct  mennlnR 
"in  context"  can  he  chosen’  What  we  describe  in  this  section,  of 
course,  does  not  constitute  anything  11Ve  a  complete  answer  to  the 
problem  of  word-sense  ambiguity.  However,  we -do  present  some  Improved 
mechanisms  for  disambiguation  in  conceptual  analysis,  and  perhaps 
clarlfv  what  the  possibilities  are. 

°.  1  ''sing  requests  to  checV  the  context 

There  are  essentially  t wo  ways  tn  handle  word-sense 
disambiguation.  Flther  the  structures  whir)  represent  alternate 
hypotheses  check  the  context  In  order  to  decide  whether  they  are 
appropriate,  or  the  context  checks  the  structures  in  some  wav,  or 
both.  Tn  conceptual  analysis  terras,  this  means  that  there  are  two 
wavs  to  accompl'sh  the  task  of  request  selection  In  order  to  handle 
ambiguity.  The  first  method  is  to  have  the  request*  check  the 
context.  ’ll  1  s  's  accomplished  hv  having  the  tests  of  the  requests 
check  as  much  as  possible  for  clues  as  to  whether  or  not  the  structure 
they  would  add  to  the  C-l.T^T  Is  appropriate.  These  tests  could  he  at 
either  a  lexical  level  f  1  ,e  .  check'ne,  for  specific  words  or  phrases), 
or  at  a  conceptual  level  (for  Instance  checking  other  structures  on 
the  f-I.TST).  For  example,  to  handle  the  difference  between  "John  left 
the  restaurant"  (P^RAVS)  and  "tobn  left  a  tip"  (ATRAA’F),  the  requests 
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associated  with  the  word  "left"  could  check  to  see  whether  something 
that  could  he  a  location,  or  something  that  could  he  an  ohiect,  is  in 
the  Input . 

*>.?  Using  the  context  to  check  the  requests 

The  second  way  to  perform  request  selection  is  to  have  some  more 

general  algorithm  which  would  use  information  in  the  context  to 

examine  the  requests,  and  choose  among,  them.  In  other  words,  we  need 

some  general  algor'thm  which  uses  the  conceptual  context  to  choose 

from  among  the  possible  structures  being  offered.  “the  traditional 

method  for  doing  this  is  to  choose  the  structure  which  can  he 

connected,  or  perhaps  connected  most  "richly",  with  other  structures 

the  system  has  in  'ts  short  term  memory.  (An  early  incarnation  of 

this  (dea  ran  he  seen  in  thf.  use  of  "selection  re s t r i c t 1 ons"  to  rule 

out  certain  comhinat'ons  of  meanings  in  Kat7  and  Fodor  (1QA1).)  In 

conceptual  analysis,  the  most  obvious  application  of  this  idea 

involves  choosing  that  structure  whir!  can  he  used  to  fill  gaps  in 

other  structures  on  the  or  that  ran  use  other  structures  on 

h 

the  f'-l.TF''  to  f'll  its  own  gaps  ,  or  both.  The  example  of  the  last 
paragraph  ran  also  h(  handled  bv  the  method  of  choosing  a  structure 
which  ran  use  other  structures  on  the  f-LlST  to  fill  gaps,  over  a 
competing  structure  which  cannot.  Th '  s  is  because  the  A  sens'*  of 

"left"  ran  make  use  of  the  structure  associated  with  "tip"  to  fill  <ts 


(A)  i  s  is  clearly  not  the  onl  v  kind  of  "connectedness"  or 
"coherence"  which  can  cause  us  to  favor  one  sense  over  another.  In 
particular,  the  structures  of  the  context  which  are  used  to  check  some 
potential  structures  nee-*  not  he  direcflv  derived  from  the  input,  that 
is,  should  also  tnr’ude  structures  derived  hv  inferential  memory 
procedures . 
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OBJECT  slot,  while  the  PTRANS  sense  can  use  the  structure  associated 
with  ’’restaurant"  to  fill  its  FRfP'  slot. 

1.1  Previous  work 

Neither  of  these  t wo  methods  is  new,  of  course.  Riesheck's  Fl.T 

has  employed  the  first  me'hod,  i  .e .  bavin*  reauests  test  the  context 

7 

to  determine  their  applicability,  with  some  success.  Wilks' 

preference  semantics  scheme  (see  Wilks  (l°7f>)l  includes  probably  the 
most  highly  developed  mechanism  of  the  second  kind,  1  .e .  searching 
for  connections  (see  also  Haves  (1°77').  FIT  also  uses  this  general 
method,  hut  at  request  activation  time,  nor  consideration  time  as  we 
are  advocating  here.  This  means  that  when  examining  a  set  of 
requests,  the  request  selection  algorithm  has  only  one  chance,  and  can 
onlv  make  use  of  the  information  the  system  has  at  that  time. 

R 

1.4  \  possible  disambiguation  algorithm 

Having  requests  check  context  requires  no  special  addition  to  the 
control  structure  of  a  conceptual  analyser,  since  the  work  is  done  hv 
the  requests.  Having  context  check  requests,  however,  requires 
augmenting  the  mechanism  which  controls  request  const dera t i on .  We 
will  make  use  of  onlv  those  ohv'ous  connections  between  structures 
wh i c h  arise  when  one  ran  f*ll  a  gan  In  the  other,  as  discussed  in 


(7)  Pieger  and  Small  are  currently  pursuing  an  interesting  line  of 
research  which  depends  hpavilv  on  this  mechanism.  Pee  Small  (1°7R1. 

fh  t  s  aspect  of  our  analvr.er  has  not  been  implemented. 
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section  •>.?.  The  algorithm  should  he  flexible,  and  that  means  that  If 

there  Is  not  enough  evidence  to  make  a  selection,  the  system  must  he 

9 

able  to  wait  and  trv  again  later. 

We  will  assume  that  reouests  are  organised  within  pools  according 
to  the  c  1  ass  1  f  1  c  at  1  on  of  section  7 . 1  above,  an-*  will  concern  ourselves 
with  those  reouests  which  strive  to  add  some  structure  to  the  C-LTST. 
The  mechanism  for  controlling  these  reouests  within  each  pool  must  be 
applied  anv  t  1m*'  the  reouests  arc  considered,  and  should  look 
something  l4 Vo  rMs  ; 

(11  Collect  those  reouests  which  4,nve  true  tests. 

(?)  nore  than  one  has  t  fie  test,  then  checV  the 
structures  which  these  add  to  the  C-1.1S-r,  to  see  If  they  can 
either  fill  a  cap  In  some  other  structure  already  on  the 
C-1.J9T,  or  can  use  some  other  structure  to  fill  one  of  their 
gaps  . 

■*  f  this  point,  three  things  can  happen;  el  the-  none  of  the  requests 
succeed  In  r h < s  check  fnr  connections,  only  one  succeeds,  or  several 
sucreed.  ’he  first  case  Is  easv  to  hanJ!e: 

(la)  7  f  none  of  the  requests  succeed  <n  the  check  for 
connection*  (step  ?),  then  len’t  let  anv  of  them  go  off 
(  1  .e  . ,  postpone  making  a  decision). 

The  second  case  <s  ilso  relatively  easv,  although  complexities  arise 
when  we  consider  the  possibility  that  what  seems  like  the  onlv  choice 
at  one  po*nt,  mav  turn  out  to  hr  a  poor  choice  later  on: 


(9)  The  ability  to  postpone  cbooslng,  a  word  sense  raises  the  Issues  of 
how  long  to  wait,  whether  there  are  default  meanings,  and  so  forth. 
(The  discussion*  of  section  B.4  are  relevant  here.)  Nevertheless  It 
seems  clear  that  the  ability  to  postpone  choosing,  for  at  least  a 
short  t*ne,  1«  necessary  'n  many  Instances. 
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Ob)  Tf  onlv  one  of  tbe  requests  succeeds  In  the  check  for 
connections  (step  ?),  then  use  that  ( i .e . ,  perform  its 
actions),  and  de-actlvate  the  rest. 

The  third  case  Is  quite  difficult: 

Oc)  Pise,  don't  let  any  of  those  remaining  ro  off;  now  a 
more  complex  decision  needs  to  be  made. 

This  third  case  probably  requires  postponing  a  decision,  until  one  or 

the  other  structure  Is  found  to  be  the  "best"  connected.  Tn  Wilks' 

system,  tbe  "best  connected"  Is  the  "most  connected",  and  this  is 

certainly  one  possible  measure.  however,  Wilks'  analyser  performs 

this  comparison  only  at  what  are  essentially  clause  boundaries,  and 

does  not  rule  out  any  possibilities  until  then.  Tn  this  third  case 

where  several  reouesrs  succeed  ‘n  the  check  for  connections,  it  seems 

plausible  that  those  which  do  not  could  be  de-activated  Immediately, 

thus  reducinc  fairlv  quickly  the  set  of  viable  alternatives. 

The  use  of  some  d i sambi pun t i on  process  as  outlined  above  would 
place  new  requirements  on  the  control  structure  of  a  conceptual 
analvrer.  Tn  particular,  we  have  often  depended  on  a  fairlv 
cons’stepf  r orre spondenc e  between  the  order  of  input  of  some  word,  and 
the  location  in  the  C-T.T<;'r  of  nnv  associated  structure.  Rut,  since 
the  requests  which  add  structures  to  the  (~-t,TPT  could  be  prevented 
fro«  flrlriR  immediately  bv  the  d  i  samb  i  pua  1 1  on  process,  such  a 
correspondence  is  no  lonaer  likely.  We  could  pet  around  this  problem 
bv  writing  more  sophist  leafed  predicates  that,  when  testipa  some 
structure  on  the  f-LTST,  would  check  to  see  whop  the  request  which 
added  it  was  activated.  More  iptuitively,  we  could  cbapRe  our  copfrol 
and  data  structures  a  bit  to  puarantee  tbe  relationship  between  order 


o'  input  and  order  on  tbe  C-l.TST.  The  easiest  way  to  do  that  would  be 
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as  follows:  whenever  a  pool  of  requests  is  activated,  a  new  empty 
node  would  he  added  to  the  C-l.IST.  Should  a  request  in  that  pool  add 
some  structure  to  the  C-l.  1ST,  it  would  add  it  in  the  corresponding 
node,  not  at  the  end  as  previously  described.  Thus,  the  O-LIST  would 
then  consist  of  a  list  of  such  nodes,  some  with  structures,  and  some 
emptv.  An  emptv  node  would  often  have  associated  requests  striving  to 
add  structures  to  the  C-l.  1 ST  f  n  that  position.  Such  a  data  structure, 
linking  the  r-I.IST  and  request  pools  explicitly,  resembles  quite 
closelv  the  one  used  in  Oershman's  NCP.  however,  his  system  uses  the 
data  structure  quite  differently  in  controlling  request  consideration. 

10.0  Ttir  P®0CRAM 

i\ir  ideas  on  conceptual  analysis  have  been  implemented  in  a 
program  which  has  proven  to  he  a  robust  svstem  capable  of  analyzing 
comnlex  input  'n  manv  domains.  It  has  been  used  'n  coniunction  with  a 
version  of  Tu 1 1 ! ng ford ' s  Script  Anp! ier  Mechanism  (SAM;  see 
CulMngford  fl°7P>),  ,inJ  as  part  o‘  leaner!  and  Purstein's  Object 
Pritnit  *ve  IVtderstand  fnp  System  fOPl’S;  see  Lehnerf  and  Purstein 
(  1  °7  ** ) ) .  It  is  currently  beinp  adapted  for  use  as  a  front  end  to 
Kolodner’s  conceptual  1  v  oriented  natural  language  data  has"  (  OYPl’S  ; 
s er>  golodrer  (l°7f>l),  an  1  for  use  in  a  conver sat  tonal  program.  The 
system  is  capable  of  ant oma t i c al 1 v  hand’ing  passive  constructions. 
The  routines  ‘or  arcorpl ishing  this  were  devised  by  Plcb  Oullinpford. 
To  give  an  Idea  of  the  range  of  the  svstem,  the  rest  of  this  sect‘on 
will  he  devoted  to  presenting  some  examples.  All  of  the  examples  In 
this  section  are  actual  input  to  and  output  from  the  program. 
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The  following  pair  of  questions,  "Who  Is  Cyrus  Vance?"  and  "Wlio 
Is  Vance  meeting’’",  are  essentially  the  same  except  for  the  addition 
of  one  word  to  the  latter.  Yet  they  differ  tremendously  in  meaninR. 


*  (  CA  '(WO  IS  CYRi’S  VANCF?  )  ) 

(FCI’TV  AC'TiR 

(pp  ppri>ss  (mrAN)  last-n amf  (vancf)  FTRST-NAMF  (CYRUS)) 
ORJF.CT 

(PP  PPriACS  (H1-AN1M)  SPFC  (*'*)) 

T1MF  (*NOW*) 

MOPF.  (NIL)) 

*(  CA  '(W1>0  IS  VANCF  ‘♦FFTTNC’)) 

( SMFFTINC  \CTOR 

(PP  PPCIA^S  (HIM AN)  LAST-NAMF  (VANCF.)  FTRCT-NAUF  (NIL)) 

ns.TFCT 

(PP  PPC IASS  (HT-ANTM)  SPFC  (*’’*V» 

TTMF  (*NOW*) 

VCPF  (NIL)) 


The  following  pa  i  r  of  questions  presents  a  problem  similar  to  the 
previous  pair.  That  is,  they  look  almost  the  sane  hut  differ  Rreatlv 
in  mean<np.  However,  in  this  case  the  reason  for  the  difference  in 
meanine  is  not  due  s'mplv  to  the  addition  of  an  extra  word,  hut  to 
more  subtle  semantic  differences. 


*( ca  'tvitfpf  pin  v.Avcf  re  i  ast  wffk’)) 

fpp  PPCI.ANN  fupvA»‘)  t.AST-NAMF  (VAN^F)  FTRFT-N A**F  (NII.)I 
OR.TNCT 

tup  ppriASS  (MU**  AN)  I. \CT-N AUF  f V A NC F )  FTRRT-N AUF  (NIL)) 

TO 

d.nc  cpfc  (*’*)A 
TT“F 

(TI«r  RFF^RF 
(♦NOW*) 

AMCl’N"r 

(PP  npeiASS  (UNIT)  TYPF  (VTFI )  NUMBFR  (NUMBFF  VAL  (*1*)))) 
pop*-  (N T  l. ) ) 
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*(CA  '(WFRF  Pin  VANCF  Cf<  ~0  COLLFCF'’ ) ) 

(SrOLLFfT.  ACTOR 

(PP  PPCLA99  (HINAS')  LAST-NAMF  (VANCF)  FIRST-NA^F  (Nil-)) 
T!UF  (*PAST*) 

VOPF  (NIL) 

PI.ACF 

(LOC  FPFC  (*->*■>)) 


The  following  example  shows  that  the  analysis  process  we  h.ivp 
describe**  Is  capable  of  handling  ’ong  multiple-clause  Inputs.  In  this 
particular  case,  the  ‘np>it  Is  not  analvrrd  *nto  a  single  connected 
concepr  ,  since  the  hnowledpi  tvvit  a  plane  crash  can  lead  to  the  death 
of  an  occupant  of  tb  plant  is  not  to  he  found  under  the  word  ")<f!l". 


”1 gber  1 evel 

processes,  such  as  a 

sc  r  1  pt 

appl ier , 

will  have  the 

neresstrv  Vnowl 

edge,  and  will  find  the 

pr  opr  r 

Conner  t 1  on 

between  the 

crash  ind  the  laath  o(  th»  r* lot. 


*  f  r.A  '(A  SMALL  PI. "a-  CTt’FFFP  1  Apr.  pm’NPS  OF  w  API  T!' ANA 

Cg^s'urp  )T  '<Tjrq  qnt  —  'i  r  pvpr  Jf  *r>pon*rpvp  \ 

LAV1'! NC  c’-stp  vn.l.’NC  ’ft  PM.ftTl) 


(WIT*'  r  ON  A 

( noopvj 

Ar'-ny  (po  ''LAcc'  fVrPTCJV) 
f  YPr  (  A  TRP!  t  *ar  > 

Si-tr  tc*M]  t  > 
otf  ( T vnr r t 
PFl  fPTJ'V 

a rro*  (nil) 

rcrT  (np  ri.\<tF  (puvgOR.t) 

TYPH  f*M) 

A*'ClrNT 

(ff  riAFF  (t'NTT ) 

TYPF  (l.A> 

Nl’MRFR 

(Vttvttro  VAl  (*1  SOP*)))! 
TO  (TNNIPP  PAR’’  fpoFVlOltR)) 
rpov  f\Tl. ) 

TT‘*F  (*PA'fr*1)) 

op.Trr‘r  (rp  riAc<:  (PHYRon.t >  typf  (crocnp)) 

PLACF  (LOT  pory 

(t,or  pony  (TOKO) 

P1R  (FOITP) 

mFT 

(pp  CtAFF  (tlVTT) 


Page  *>n 


TYPF  (VILE) 

NUMB  FT 

(NfVBFR  VA1.  (*10*)))) 

TIVE  ( *PAFT*) ) 

Cf'SB 

( ^approach 

VFN  (PP  riJVSS  (NIL)  RFP  (r>FF)) 

FIFl.b  (I.oc  Lnr-nfPF  (LANTMNC-F  IFLDl  IFF  (1NDFF)))) 

(LFAD-’C 
ANTE  (NIL) 

CONNP  (HEALTH 
ACTOR 

(PP  ClAcF  (Ht^AV)  TYPF  (PILOT)  orr  (DFF)) 

VAL  (-10.1)) 


11.0  CONCU’RION 


Our  vorV  on  conceptual  analysis  has  vielded  several  different 
sor  t «  of  conclusions.  On  a  t  hi'orct  1c  al  level  ,  our  malor  claim  Is  that 


(1)  The  conceptu.il  analysis  proeess  we  hive  presenter*,  ns  well  ns 
previous  wort ,  provides  evidence  for  the  hypothesis  thnt  prior 
syntactic  analysis  is  unnecessary  in  1  anguago  understanding. 


Other  theoretical  claims  include: 


(?)  In  order  for  a  language  analysis  procedure  to  be  able  to 
successful  1 v  analvre  milri-clause  const r ur 1 1  on s  and  complex  noun 
erotips,  .in'*  to  he  capable  of  handling  word-sense  ambiguity,  it  must 
conform  to  the  rr'terion  of  flrx!h*litv.  ’his  criterion  states  that 


an  analyzer  must  he  ah’e  to  operate  In  hoth  a  top-down  and  hot  tom-up 
mode  with  equa1  facility. 


(1)  In  order  for  an  analyzer  to  conform  to  the  cr*terioo  of 
Flexibility,  if  must  have  a  flexible  short  term  me—  ory.  We  have 


proposed  the  use  o*  a  simple  ordered  ’1st  of  element®,  the  C-LIRT 
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(/«)  In  order  to  conform  to  the  criterion  In  connection  with  the 
problem  of  word-sense  disambiguation,  a  language  analyzer  cannot 
decide  among  competing  ex  per t at  1 ons  and  structures  solely  at  the  time 
they  ire  activated.  The  decision  must  he  made  at  the  time  the 

expec t a t 1 ons  are  considered,  and  the  algorithm  must  he  capable  of 

postponing  a  decision  In  some  cases. 

(S)  Wo  have  shown  that  pr'or  syntactic  expectations  at  the  start 
of  a  sentence  are  unnecessary  i‘  the  criterion  of  flexibility  Is  met. 

Wo  V'avo  also  discussed  tl  c  following  Issues: 

( *> '  *  partial  sped  fleet  Ion  of  the  notion  of  syntax  from  the 

point  of  view  of  <rs  use  In  a  conceptual  analyzer  (see  section  q . 1  ' . 

(’I  ‘rh«  notion  of  intelligent  error  correction  and  its  relation 
to  tf'e  proh !  o-  ft  amhfculfv  t  seo  section  ° .4). 

( i>  '  \  co~pi>-‘son  o  t  some  previously  described  method*  for 

performing  wnrd- sense  1  1  c  a- h  >  gua  r  *  on  ,  whirl  shows  that  they  are 

surpr 1  *  * ng ' v  similar  <  see  section  . 

In  ad-i‘r*on,  the  vmrk  described  ‘'ere  has  contributed  to  our 
technical  knowledge  of  conceptual  analysis,  resulting  In  'mproved 
algorithms.  ‘TVe  se  technical  results  Include: 

(Oa  An  improve'  vocabulary  for  the  tests  an-*  actions  n*  reejuests. 
(cee  sections  1  and  s  ‘nr  an  exno*it*on  n'  request  tests  and  actions.) 
Th * s  request  vocabulary  Is  'n  some  sense  a  programming  language.  Varv 
sections  o‘  *h's  pip-r,  particularly  section  f ,  v>ave  described  the 
proper  use  of  t h 1 s  language  In  wt  1 1 1 ng  reouesfs. 
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(10)  The  use  of  the  recency  rule  to  orgnnlgp  active  requests. 

(11)  Vow  noun-croup  and  clause  level  analysis  ran  he  Hone  using 
essentially  the  s.inr  control  and  data  structures.  If  the  recency  rule 
1  s  user!  . 


What  are  the  Important  Issues  for  future  vaorW  In  language 
amlvals’  First  of  all,  we  must  gain  a  much  better  understanding  of 
how  higher  level  memory  structures  can  he  user*  In  the  analysis 
process.  The  importance  of  this  question  will  become  apparant ,  we 
believe,  particularly  as  va-  trv  to  address  better  the  problem  of 
vnr<1- sense  ambiguity.  Of  course,  how  well  we  can  apply  memory  in  the 
parsing  process  will  depend  on  how  well  ve  understand  memory.  That 
remains  the  most  difficult,  h,,t  most  crucial,  Question. 
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SPP'-'N'iIX:  A  retailed  Fxnnple 

This  st'f  Hon  w'll  bp  devoted  to  discussing  a  fairly  long  example 
In  some  detail.  Tbe  example  Is:  "A  small  plane  stuffed  wrltb  1 S00 
pounds  of  marlluana  crashed  10  miles  south  of  here."  The  dictionary 
entries  exhibited  are  not  particularly  general,  however  they 
illustrate  the  varletv  of  actions  whirl'  the  analvrer  must  perform. 
The  example  will  trace  the  execution  monitor,  describing  the  state  of 
the  T-Ll^T  and  of  the  request  pools  as  the  sentence  is  analvred.  We 
assume  that  the  C-l.l‘lT  1  s  NIL  and  there  are  no  request  pools  at  the 
start  . 


O' T  ’Tif  'TVT  IT'1:  In  tMs  case  the  firs*  word  of  the  sertence,  "a", 
■'he  program  switches  irom  normal  to  noun  group  mode.  ( ’’"he  current 
mode  is  4e?ermined  bv  using  fershman's  (1077)  heuristics  for  noun 
group  boundaries.! 

Co»;cipft>  pvrrrqm*;  loovj vr  ?rt>  ^PPriFir  vorp^:  (Tbere  aren't  anv.) 

LOAH  Tnr  oppcfct^  FPO"  nr  rjr~lP‘ivPY  P»-rRY;  ~hr  rn,rv  for  "a"  loohs 
aomefbing  1  He  this: 

(PFF  A 

(  RPfX'Pg-e 

|TF<:'":  "f'nd  r  concent  follow1np  vou"l 

|  ACTIONS :  "add  (®W  (i\tiFF7)  to  ir"P 

T^r  request  *s  nnred  RFt'l  bv  the  svstem  an4  activated  in  PF*ciL~l  .  Note 
t4'.if  t  h 1  s  1  s  t  refluf  sf  w4'  ?  c  h  add  s  the  gap  1  P  FF  '  that  *t  will  *111* 

rnN'ThFR  PFd'PP-c  IV  vopv  rvri’n  "cnr  :  PFH  t*  considered  h»,t  does  not 

fire. 

(-d  TUP  VFVT  jmga.  .  "email". 

rov^inro  oFH'P'tmp  I/Virtyr  rev  crpctrjr  vrenc:  (There  aren't  anv.) 

l.^AT  TJIf  PF  rt’P  FTC  PPps*  ■nip  nt  eryoVAPY  V*TPY:  The  entry  for  "small" 
loohs  something  1  He  this: 

(npr  o«»'  j 
( SPfprcr 

(TFST:  "find  pp  on  'nllnwlne  vou"' 

lArmjnvq;  "add  (ft?f  (cvAt.1.))  to  it"!  1 
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The  request  Is  named  by  the  svstem  and  activated  In  POOL-?. 

CONSI0FR  RFOTFSTS  IN  NOUN  CROUP  UOPF :  PFO?  U  considered  but  does  not 
fire. 

OFT  T**F  SPY”  1TF«:  "plane". 

CONSTOKR  RFOUFSTS  I.OOKINC  FOR  cpFCIFTO  UORPS;  (There  aren't  inv.) 

LOAO  THF  RF.OUFSTS  from  -niF  r>irT!ON»«>Y  F NTR v :  Tbe  entrv  for  "plane" 
looVs  something  like  this 

(OFF  PI.AW 
(PFOVFST 
|Tf<?t:  T1 
( AOTTONS; 

"add  (PP  CUSS  f VrM TCLF  )  'rvT’v  (AIR  PLANT 1)  to  0-!.IST"l) 

Recall  that  all  structures  are  added  on  the  end  of  the  C-1,1CT.  The 
request  Is  name'4  BFOA  hv  the  system  and  activated  in  POOL-I. 

CONSIDER  RFOUFSmc  IN  NOUN  OROl'P  MppF  :  RFOa  Is  considered  and  fires. 
The  result  is  that  pool -1  Is  now  empty,  and  the  C-L1ST  *  (PON1)  where 
OON  1  -  (PP  CLASS  (VFHIOIT)  a-ypjr  t  A  4 R  FT. A N'*' )  )  . 

0FT  TVF  NFXT  1TFU:  "stuffed".  The  program  switches  from  noun  proup 
to  normal  mode.  Fecall  that  normal  mode  sepulres  the  execution 
monitor  ‘o  Immediately  consider  all  active  requests.  So,  the  monitor 
checks  all  of  the  request  non' s ,  from  most  recent  to  least.  RFC?  and 
PFOl  both  fire,  and  the  end  result  is  that  all  the  request  pools  are 
empty,  with  CONI  -  (P"  CLASS  (VFHTOLF)  TYPF  ( A  TR  PLANT )  Sl’F  (S'4  A  LI.) 
RFF  (  T  VT>*F  )  )  . 

CONS  T  OF  R  PFCUFS-ss  1/Y>F1NC  FOR  «:pFCIF10  WORPS;  (Tore  aren't  any.) 

LO.AP  THF  PFfl’FSTS  FP™  tVF  MOTJONARY  PNTY:  -rhe  entry  for  "stuff" 
looks  somethin!*  like  this: 

(OF*  CT1TF 
(RFtVFST 
(TFST:  T? 

|  ACT  TONS': 

"c-rco  ..  .,,14  lp-rt>A»s;  ^r^OO  (Nil.) 

OA.Tvr-s  In  T  l,  ) 

TO  ( T  VS  T OF  PAR”  (NT!.))  ) 

to  r-LTS”" 


"sc t  1  vat  e 

(prrvFCT 

|TFST :  "the  next  word  Is  VTTU'M 
( A0T1ONS : 

"activate  In  the  next  pool,  marked  Hph  priority: 
( pForrer 

ITFSt;  " f i n  1  PP  on  C-LTST  and  (TO  PART)  slot  of 
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STRO  Is  fll 1 ed" ) 

| ACTIONS :  "put  It  4 n  the  ORJFCT  slot  of  FTRO"! ) 

(RFCUERT 

fTFST:  "find  PP  on  r-U«5Ti  preceding  <^-R0"] 

|  ACTIONS :  "add  (RFl  (STROM  to  It  and 

put  If  <n  ( TO  PART)  slot  of  ^RP"!  1) 

The  variable  ^PP  (which  Is  replaced  hv  a  svstem-uni quo  symbol)  Is  sot 
to  the  P'f'F  A  VS  when  the  roquost  is  executed.  f'RO  is  usod  to  save  the 
structure  for  other  requests  to  reference.  The  roquost  is  named  PFP4 
hv  the  svstor.  and  activated  4n  POOL-4. 

RFCI'F^TS  \PF  CPNS  IDFRF.D  TV  NOPmai  *«npp :  FFP4  is  triopered,  so  now 
r-l.lST  •  ( ms  |  r  o\  p  A  (  where  CPN?  is  the  PLAN'S.  Another  request  is 
activated  as  RFCS,  which  is  put  in  the  snec4ul  pool  loohinR  for 
particular  words. 

ftT  -nip  sfyn"  r-rv ;  "vith". 

CPVSiriFP  pent-rerq  LOOFTNC  Fon  SpFO  IF  TC  VOTF*:  °F "S  is  t r 4 p.pored  . 

Because  of  the  nature  of  the  action  of  PrPS,  the  execution  monitor 
proceeds,  not 'ns*  it  must  add  two  new  requests,  PrPh  and  ®FP7,  to  the 
next  request  pool. 

lOAP  TI*F  RFCL’FSTS  (tVOF »  ^tt  ricTTPVA»V  pvtoY:  Tn  fh4s  instance,  it 

doesn’t  reallv  matter  what  the  requests  listed  under  "with"  are,  since 
the  requests  added  hv  PFPS  are  the  proper  sense  of  the  word  in  this 
local  context.  fence,  when  !>'4"1l.~t>  is  hui  1  t  ,  t,rP*>  and  Pr07  are  added 
to  it.  Thev  have  i  i-'phor  priority  than  the  requests  listed  under 
"with"  in  the  dictionary. 

CONSTOFR  Prn’F  STS  TV  voow  a  I  WOPF:  PF07,  which  hui  Ids  the  RF1. 

structure,  is  tr4ppored,  and  so  now  C-LIST  •  ( TON | ) ,  where  (TNI  ”  (PP 
Cl.ACS  (Vf'Tri.n  T'TF  ( A  TR PLANT )  M7F  (S‘4AL1.)  PFI  (PTRAVS  A'*T ™  (NIL) 
OBJECT  (NT1.''  fp  (TfTSTnr  PACT  ( CON  1) ) ) )  .  ‘rhe  onlv  remaining  aetive 
request  is  PFPh,  which  strives  to  fill  the  PRJFCT  slot  of  the  F^RAVS. 

(TFT  Taic  •.tvy  ;tf«  ;  "|SPO".  The  execut4on  mon4tor  chanRos  to  noun 

p  roup  mode  . 

(-ovcTpro  Pta’rc-c  i/aopt  \*r  FP°  cprrjFTe  WP*>OS:  (There  a'en't  anv.l 

I.p AP  ■'"F  oyrtTFsmq  roow  rair  nt  rr jovaoy  F«-r rv.  mho  prop,.,,,,  reropni  res 
that  "1  AOO"  <«  numher,  and  for  f^e  sate  of  conven'ence  generates  a 
cor  r  e  spond  4  op  literal  atom  *|SPP*,  with  a  defin'tlon  somethinp,  liVe 
this: 

(  flFF  •  1  SOP  * 

(qrrq*pe-r 

[Trqm.  T ) 

[APTioNs:  "add  (»ji-v.bfR  VA1  (MAPO*)  to  C-LTST"  1  1 


This  is  named  PFPR  hv  f  t*e  s  vs  tern,  and  activated  in  1*001. -A . 

PPVSTPFo  osotircrq  tv  NOPV  rsp  up  'TPF :  P*o°  is  tripRered,  and  the 
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oust  -  (coni  coni)  wti.*rc  co?n  -  (nh*«rfp  vai.  (*ison*>>. 

OFT  THF.  NT  1TFM  :  "pounds". 

CONSTPFR  RFfTFSTF  l.OOKTNC  for  SPECIFIC  VORPS;  (r^PTP  aren't  any.) 

Loap  r»»F  RFWFSTS  FRO*4  THF  PICTIONARY  FNTRY:  the  entry  for  "pound" 
looks  something  like  tbls: 

(OFF  POllNP 
(REOUF.ST 
ITFST :  T) 

(ACT IONS: 

"cpvo  add  (PP  CIASF  (PNIT ' 

TYPF  (l.R  1 
N!’'<RFR  (*111.11 
to  r-l.lFT" 

"net  1  v.ito 
( RF.rt’F^T 

|TFST:  "find  a  number  preceding  ‘TRO 
on  tbe  r-l.lFT’M 

[  ACTIONS :  "put  It  In  tbe  Nlb'PFR  slot  of  STRO'M) 

(RFOOFVT 

|'rFRT:  "next  word  Is  CF”  ) 

[Afpiovc: 

"activate  In  tbe  next  pool,  narked  Mffb  priority: 

(RF.CUFSt 

'TFST:  "If  voti  ‘  I  nd  a  PP  on  OUST  followlnp  STRO"  1 
!  ACTIONS ;  "add  (  AMnnfT  c-cro)  fo  lt"'H 

'rbls  Is  named  RFCR  and  activate'4  In  1*701,-7  bv  tbe  system. 

rnVMPFB  RF<'VFc’’c:  IV  NOUN  CROpe  “OP* :  ofoo  i*  trlcpered,  so  that  tbe 
C-l.TRT  -  (OON1  COV  roN41  where  rosu  Is  tbe  representation  for 
"pounds".  Also,  fHe  reouesf  1  ooH  np  for  a  number  Is  activated  as 
PF^IT  In  PHOL-P ,  which  should  be  considered  In  noun  eroup  mode.  Tbe 
other  request  Is  activated  *n  tbe  pool  (nr  requests  tesflnp  for 
particular  words  is  PFP11.  p KO 1 0  trippers,  an4  O-l.TFT  m  (CONI  CON4), 
w^ere  0PN4  -  (PP  CIASC  (UNIT)  TYPF  (1.R1  NOPm  (M'vRF®  VAI  (*1SOO*))). 

OF  T  rur  vrv-r  tTFw  :  "of". 

CONS1PFR  RFOUFSTN  I.ooft  vr  rrs?  cprojFTO  VPPPS:  RFOH  Is  frlpcered,  and 
because  of  t^e  nature  of  Its  action,  tbe  execution  monitor  proceeds, 
notfnp  If  must  add  a  new  rcouesf  ,  VFOl?,  to  tbe  next  reovtest  pool. 

LOAP  THF  oroi’FSTS  PRO**  ^F  PTCTTOJJARY  FNTY:  Apaln,  since  tbe  sense 
of  tbls  word  Is  locally  cbinRod,  It  doesn't  matter  wbat  they  are. 
However,  POOT,-n  Is  built,  and  pFOl?  4s  activated  In  It. 


COW  1PFR  RrrtlFVTS  IK  NOUN  CROl’P  “OPF :  PP017  Is  considered,  but  falls 

to  fire; 
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CKT  THF  NT  XT  PTM :  "mar  1  luana"  . 

CPNSTDFR  RFCUF.STS  LOOKTNC  FOR  SPFC1FIC  WORDS:  (There  aren't  any.) 

LOAD  TH*  RFOI'F.STS  FROM  THF  DICTIONARY  ENTRY:  the  entry  for 

"mar  1  luana"  looks  somethin?,  like; 

(OFF  MARIJUANA 
(RFOllFST 
|TFRT :  Tl 

I  ACTION'S :  "add  (PP  ClA^s  (PHYSor.i)  TYPF  (MJ)  to  C-LIST"|1 

This  Is  named  PFP1T  hv  the  system  and  activated  In  POOL-10. 

CONSTDFR  RFOUESTS  tv  NOUN  CROUP  MODr :  PFOH  Is  triRRcred,  So  now 

C-LtF'r  •  (CONI  CON 4  CONA>>  where  CON'N  Is  the  representation  for 
"marl  luana"  . 

CFT  THF  NFXT  ITEM;  "crashed".  The  execution  monitor  switches  from 
noun  p.roup  mode  to  normal  node,  and  so  Immediately  considers  all 
active  requests.  Rv  recency,  PFPI?  Is  considered  first,  and  tr1??ers. 
Now  C-LIFT  -  (CONI  CONS)  where  CONS  -  (PP  ClASS  (PHYSOR.I)  t ypf  (MJ) 
AMOUNT  (PP  C1AFF  (I’NIT)  TYPF  (LR )  VUMBFR  (NUMRFR  VAL  (*|S00*)))); 
RFPA,  which  was  activated  to  flll  the  PR.TFCT  slot  of  the  subordinate 
PTR  A  VS ,  is  t  r  1  (titered  ,  CON'S  f  1  11  s  the  PR.TFCT  slot,  and  0-L1ST  -  (CON'D 
a?atn.  There  are  no  more  active  requests. 

CON'S  Tr>F°  RFPUFSTS  LOOKINC  FCR  SPECIFIC  WORDS:  (There  aren't  anv.) 

1,0  \  p  mwr  RPfVFcTS  PR  on  -mtv  PIOttonaRY  p‘TRY:  The  entrv  'nr  "crash" 
looks  somethin?  like  t>1s: 

(n*F  PPASW 
(PFrVFc'r 
| TEST:  Tl 
| ACTIONS : 

STO  "add  (PRorfl  \cmnq  (Nil.) 

OR. TFOT  (NIL) 

PI. acf  (NIL)) 

to  C-LIST" 


"art  1 v  a  t  e 
( RECUF ST 

irvqT:  "find  a  PP  which  i«  ■,  phvsiral  ohlert 

precedlnc  cTRO  on  the  C-LTCT"! 

(ACTION'S:  "put  it  in  the  ACTOR  slot  of  FTR0"1 
(PFCTpst 

I tEST  :  "find  a  PP  which  Is  a  location  on  the  C-LIFT'"1 
( APT  IONS :  "put  It  In  the  PI.ACF  slot  of  STRO''|  11 

This  Is  PP 0 1 4 ,  activated  In  POOL-11. 

CON'IDF*  RFfUFFTF  IN  N'ORMAl  "PDF  :  RF014  Is  tr<*pered,  and  the  C-L1ST 

-  (CONI  OPNA)  where  CONA  Is  the  representation  for  "crash".  Also,  two 
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now  requests,  PF.OIS  and  PFPlh  are  activated  In  POOL-1?.  These  are 
considered,  and  RFPIS  Is  triggered,  which  places  TONI  In  the  ACTOR 
slot  of  TONh,  so  that  C-LIST  •  (OONh).  PFOl*  <s  not  tr'ggorol. 

nr-r  —ur  «t  vm  j-r--;  ”10".  'V'tr*-  to  noun  group  moV. 

rn»;q  Torn  prorF.F'rF  l/toviNC  FOR  FprriFIP  UPROF:  (There  aren't  anv.l 

LOAF  t»1F  RFCI*FFTS  FRO*-'  TMF  ni0',,lONA*'Y  FVTRY:  Again,  the  litoral  atom 
*10*  Is  used  In  place  of  the  number  10.  the  following  entry  Is 
const  rur  fed ; 

(OFF  *10* 

(RF<TFST 
|TFFT:  T 1 

I  anions  :  "build  (K1TVRFR  VAL  (*|0*))"1 
Th*s  Is  RFP|7,  activated  In  POOL-11. 

OovsinFR  PFrt’VFTR  IV  NOON  PRopp  *»opp .  RFOI 7  Is  triggered,  so  C-LTFT  - 
( OOh’fi  CON  7)  where  CO N7  -  (VI’VSFR  VA1.  (*10*)). 

f>-r  -nir  vf  yt  1  rgw  •  "miles”. 

rOKRIOF.P  RF CCF STS  I.OOyTNO  FOR  FprriFTO  WO opF;  (There  aren't  nnv.) 

LOAT  TWF  PFfVFFfq  fro**  -epF  TM  0Tto»;  ARy  tv* RY:  In  this  rase: 

(  off  "rr.f 

(RFfV*FT 

[Tgg-e.  Tt 

I ACTIONS : 

STRO  :*  "add  (pp  n/cc  fltVTT) 

TYPF  (MT1.F  ) 

VttMgro  (NIL  1 1 

to  0-LTST" 

"ac  t I  vat  e 

(prrrFRT 

ITFFT:  "find  a  number  preceding  Ffpn  on  P-LIF^"! 
lAOTTOVF:  "put  <t  In  the  MIMRFP  slot  of  cTgn"ll  1 

^Is  Is  RROl  P ,  ac  r  *  vat  ed  In  POOL-14. 

OOK5 10FR  RF0ITFFT5  TV  NOUN  CRO(*p  wopg :  RFOIP  is  tr*ggered,  so  C-LTF‘r  - 
f  oof  ;A  OON7  rr*;p>  where  0O\P  fs  the  representation  for  "mile".  Also, 
RFO)  n  fa  activated  *n  POOL-1 S,  and  then  also  considered.  It  f*res,  so 
that  the  r-LT<:T  -  (rcttf .  rot’P)  where  COUP  -  (PP  CUFF  (UNIT)  TYPF. 
( *'Tl.F  1  Vl~PrR  (Ntt'*RFR  VA1.  (*|0*))). 

OP-  THF  VFXT  !tV«:  "south". 


rovMOFR  PFOIIFF^F  LOnytvr  FOR  FpvOIFIO  VPRpF;  (There  aren't  any.) 
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LOAD  THE  RFnt'FETg  from  tvf  mrTT onaRY  ENTRY:  The  enrrv  for  "south" 
1  s  : 

(OFF  SAITH 
(RFfX’FST 
|TFST:  T! 

|  ArTmNE ; 

ETRP  :•  "add  ( PROX  PART  (AMI.) 

P  1  R  (S) 

DT ST  fNID) 
to  r-LIET" 


"ac  t  1  vat  e 

(rfojfrt 

1TFET:  "*1nd  a  d'stxnce  un '  t  preceding 
ETRP  on  the  C-L TFT" 1 

|A(~TiosR:  "put  It  In  the  PIET  slot  of  F‘rPP"l 
(prnPFET 

(TEST:  "the  next  wnt(<  Is  OF'M 
1  ACT TONE : 

"activate  In  the  nexr  pool,  narked  as  Mph  nrlorltv: 

(RFrV'ET 

f  -  "flnf  a  structure  representing  n  location 
fol  lowing  e-trO  on  the  r-UET") 
lACTtovs.  "p,lt  ,t  <n  thp  part  slot  of  ETRP")  1  1 

This  Is  PFP?0,  activated  In  POni.-lf. 

CONRTPFR  ovrtlFE-cs  IN  HOI'S  PR 0!'t>  Mor,v:  pyrpo  Is  triggered,  and  now 
r-UET  *  ( rnsjf  PC*NP  CON0!  vd'ere  COVE  Is  the  structure  representing 

"tout*'" .  Also,  0FP?I  is  activated  In  PtAl.-l7,  and  PFP??  In  the 
special  pool  o'  requests  looking  for  specific  words.  RF0?1  fires,  and 
so  now  r-UET  -  (cosh  rc«VO>  s-ti ere  rn\0  .  (PRry  PART  (Nil.)  PTR  (El  PIET 
(PP  CLAEE  (!tNTT )  TYPF  (VT1.FI  \1~RFP  (M~RFR  VA1  (*1P«)>II. 

CFT  THC  Stvt  tTFM :  "of". 

COVETPFR  prrytgg-rs  I/V'VIST  FAR  EnrcTFTr  VOPPE:  RFO??  Is  triggered,  hut 
waits  until  the  next  request  pool  Is  activated  to  add  a  request  , 
PFO?l. 

IAAP  T'*F  RFCI'Este  gpc**  -cup  PICTI^NARY  FVTRY:  Again,  since  the  moanlnp 
of  "of"  will  he  loca’lv  changed.  It  doesn't  matter  what  the  dictionary 
request  for  "of"  has  In  It.  I’nwcr,  PEP71  Is  .activated  In  POPl.-lF. 

f't'NE  T  PF  R  RFcttgcTc  TV  NOl’N  r»r>UP  uopF :  pcr7T  Is  considered  hut  does 
not  fire. 

CfT  TV''  NEXT  TTV :  "here". 

rrvETPFR  PFCTF  etr  1/anvtvr  FPR  Fppr  TFIr  WOROE;  (There  aren't  anv.I 

t/*AP  THE  EFfVrc-E  FP^  TV*-  Pir'r’nVAPY  FVTRY :  In  this  caRe,  the  entry 
looks  something  like  this: 
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(OFF  IfF.PF. 

(RFCL'FST 
|TFST:  T I 

(ACTIONS;  "add  (1/>C  PRnx  (*HF.RF*))"I  ) 

This  becomes  RF.O?4  in  POOL-1 R. 

CPNSIPFR  PFOUF.FTS  IN  NOUN  CROUP  MOPF :  RFO?4  is  triggered,  and  changes 
the  C-l.IST  to  (CPNh  rPNO  CON  10). 

err  THF  NFXT  ITFM;  "ppriod".  Switch  to  normal  mode  of  tbp  execution 
monitor.  This  meins  checking  all  requests.  PEO?/«  is  triggered  and 
C-LTNT  -  (CONh  CONQ)  whprp  rnN**  -  (PRO*  PART  (l.oc  PROX  (*HFRF.*) ) 
PI  R  (S)  PINT  (PP  CIASC  (I’NIT )  T  YPF  (MT1.F.)  Nl^PFR  (NUMBFR  VAl. 
(*10*)))1.  Then  RFP17  is  considrrpd  and  trlRRers,  filling  tbp  Pl.ACF. 
slot  of  COS’h  with  CON'S,  Since  period  signals  the  end  of  a  sentence, 
there  are  no  more  active  requests,  and  the  analysis  has  constructed 
one  complete  conceptual  i  gat  ion ,  we  are  done.  f-!.!ST  »  (CONf)  where 

rout  - 

(propm  Arrog  (rovi) 

OR.TFCT  (NIL  ) 

Pl.ACF  (COVR)) 


CONI  - 

(PP  r  1>CS  ( VF.HI C1F  ) 

-ryvr  (MR PI.ANF. )  S17F  (F“ALL) 

RFf.  (P’-RAVN  ACTOR  (NM. ) 

OR.IPCT 

('PP  rMit  (pvtYNOB.t)  TYPC  (‘Ml 

amoitnt 

(PP  C1>RF  (UNIT ) 

TYPE  (l.Rl 

N1~RFR  (NUVRFR  VAl  (MSOP*)))) 
m  (1NFIPF  PA»>T  (CONI)))) 


rm.’O  - 

(pony  part  dor  pony  (*mfrf*)) 

PIR  (F) 

PINT  (pp  CLARS  (UNIT)  TYPF  (Nll.F) 

NPAFR  (AjttworR  VAl  (MO*)))) 


■ _ ■ 
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